-- Logs begin at Mon 2022-07-25 21:45:09 UTC, end at Mon 2022-07-25 23:13:27 UTC. -- Jul 25 22:46:32.306786 dv-osbrick-849020-3-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 22:46:32.314115 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 22:46:32.316149 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 22:46:32 2022] *** Jul 25 22:46:32.316149 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 22:46:32.316149 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 22:46:32.316149 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: nodename: dv-osbrick-849020-3-ceph Jul 25 22:46:32.316149 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: machine: x86_64 Jul 25 22:46:32.316149 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: clock source: unix Jul 25 22:46:32.316149 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: pcre jit disabled Jul 25 22:46:32.316604 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: detected number of CPU cores: 4 Jul 25 22:46:32.316604 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: current working directory: / Jul 25 22:46:32.316604 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: detected binary path: /usr/bin/uwsgi-core Jul 25 22:46:32.316604 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: your processes number limit is 47680 Jul 25 22:46:32.316604 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: your memory page size is 4096 bytes Jul 25 22:46:32.316604 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: detected max file descriptor number: 2048 Jul 25 22:46:32.316604 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: lock engine: pthread robust mutexes Jul 25 22:46:32.316604 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: thunder lock: enabled Jul 25 22:46:32.316604 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 22:46:32.316604 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 22:46:32.362720 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: Python main interpreter initialized at 0x557357adf9c0 Jul 25 22:46:32.362720 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: python threads support enabled Jul 25 22:46:32.362720 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: your server socket listen backlog is limited to 100 connections Jul 25 22:46:32.362720 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: your mercy for graceful operations on workers is 90 seconds Jul 25 22:46:32.363079 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 22:46:32.363191 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: *** Operational MODE: preforking *** Jul 25 22:46:32.363444 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: *** uWSGI is running in multiple interpreter mode *** Jul 25 22:46:32.363444 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: spawned uWSGI master process (pid: 93652) Jul 25 22:46:32.363648 dv-osbrick-849020-3-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 25 22:46:32.364222 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: spawned uWSGI worker 1 (pid: 93655, cores: 1) Jul 25 22:46:32.369602 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: spawned uWSGI worker 2 (pid: 93656, cores: 1) Jul 25 22:46:32.369602 dv-osbrick-849020-3-ceph devstack@keystone.service[93652]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 22:46:38.121197 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 22:46:38.121197 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: from cryptography.utils import int_from_bytes Jul 25 22:46:38.122028 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 22:46:38.122028 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: from cryptography.utils import int_from_bytes Jul 25 22:46:38.122570 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 22:46:38.122570 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: from cryptography.utils import int_from_bytes Jul 25 22:46:38.123022 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 22:46:38.123022 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: from cryptography.utils import int_from_bytes Jul 25 22:46:38.172176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 22:46:38.172377 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 22:46:38.172467 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 22:46:38.172567 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] command line args: [] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 22:46:38.172645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 22:46:38.172765 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] command line args: [] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 22:46:38.172851 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 22:46:38.172984 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ================================================================================ {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 22:46:38.173063 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 22:46:38.173246 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ================================================================================ {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 22:46:38.173910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] admin_token = **** {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.174066 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] admin_token = **** {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.174206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] config_dir = [] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.174428 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] config_dir = [] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.174518 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.174649 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.174763 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] config_source = [] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.174888 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] config_source = [] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.174888 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] debug = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.175081 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] debug = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.175193 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.175425 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.175558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.175665 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.175762 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.175873 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.175978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.176082 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.176185 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.176287 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.176390 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] list_limit = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.176484 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] list_limit = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.176587 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] log_config_append = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.176691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] log_config_append = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.176793 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.176895 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.176991 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] log_dir = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.177091 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] log_dir = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.177195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] log_file = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.177308 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] log_file = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.177400 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.177525 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.177617 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.177684 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.177811 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.177893 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.178014 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.178098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.178222 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.178299 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.178425 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.178509 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.178632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.178713 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.178780 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.178857 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.178940 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.179006 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.179081 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.179150 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.179220 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.179292 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.179363 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.179434 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.179612 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.179710 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.179855 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.179947 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.180147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.180242 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.180619 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.180697 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.180800 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] publish_errors = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.180880 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] publish_errors = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.181031 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.181115 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.181259 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.181336 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.181437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.181512 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.181700 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.181803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.181942 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.182028 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.182178 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] standard_threads = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.182320 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] standard_threads = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.182501 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.182627 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.182751 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.182878 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.183008 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.183137 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.183272 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] use_journal = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.183346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] use_journal = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.183504 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] use_json = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.183636 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] use_json = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.183849 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] use_stderr = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.183935 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] use_stderr = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.184009 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] use_syslog = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.184075 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] use_syslog = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.184134 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.184196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:46:38.184254 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.184320 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.184384 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.184447 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.184509 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.184567 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.184623 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.184689 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.184902 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.185028 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.185153 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.185279 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.185406 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.185541 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.185700 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.185829 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.185963 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.186090 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.186217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.186351 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.186479 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.186605 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.186753 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.186881 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.187014 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.187153 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.187281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.187410 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.187536 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.187669 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.187798 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.188003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.188134 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.188262 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.188396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.188533 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.188667 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.188802 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.188890 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.189009 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.189132 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.189259 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.189385 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.189520 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.189675 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.189799 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.189933 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.190060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.190197 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.190334 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.190468 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.190595 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.190720 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.190846 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.190973 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.191108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.191235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.191363 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.191490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.191615 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.191752 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.191885 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.192021 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.192148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.192280 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.192408 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.192543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.192543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.192787 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.192907 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.193029 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.193155 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.193289 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.193417 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.193550 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.193708 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.193845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.193972 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.194171 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.194300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.194427 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.194554 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.194681 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.194807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.194941 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.195068 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.195194 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.195321 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.195453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.195591 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.195730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.195867 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.195989 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.196115 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.196242 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.196374 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.196516 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.196645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.196771 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.196897 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.197023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.197151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.197296 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.197423 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.197555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.197702 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.197830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.197987 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.198126 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.198254 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.198381 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.198508 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.198634 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.198763 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.198897 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.199031 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.199172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.199300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.199427 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.199554 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.199689 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.199828 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.199956 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.200095 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.200231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.200358 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.200486 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.200622 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.200758 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.200898 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.201026 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.201154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.201282 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.201409 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.201545 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.201728 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.201849 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.201978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.202105 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.202228 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.202368 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.202497 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.202639 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.202770 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.202898 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.202981 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.203102 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.203228 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.203355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.203488 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.203616 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.203750 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.203878 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.204006 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.204133 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.204260 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.204877 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.205016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.205142 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.205272 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.205394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.205536 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.205740 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.205886 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.206023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.206153 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.206153 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.206396 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.206524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.206661 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.206802 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.206931 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.207059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.207188 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.207323 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.207524 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.207654 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.207735 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.207894 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.208021 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.208156 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.208293 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.208433 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.208433 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.208698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.208827 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.208954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.209081 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.209155 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.209322 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.209457 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.209628 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.209755 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.209884 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.210011 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.210150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.210285 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.210423 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.210551 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.210678 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.210806 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.210806 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.211057 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.211184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.211318 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.211318 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] auth.external = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.211559 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.211695 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.211829 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.211829 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.212070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.212214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] auth.external = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.212351 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.212505 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.212642 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] auth.password = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.212642 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] auth.token = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.212899 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.213030 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.213157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.213284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.213421 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] auth.password = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.213550 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.213688 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] auth.token = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.213814 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.213949 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.214075 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.214210 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.214344 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.214470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.214595 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.214720 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.214844 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] credential.caching = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.214976 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.215103 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.215229 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.215359 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.215486 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.215611 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.215758 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] credential.caching = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.215883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.216008 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.216142 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.216274 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.216400 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.216533 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.216665 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.216796 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.216796 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.217037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.217163 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.217295 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.217295 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.217541 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.217685 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.217823 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.217953 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.218090 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.218221 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.218349 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.218477 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.218605 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.218735 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.218871 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.219000 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] federation.caching = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.219128 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.219267 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.219396 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.219523 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.219663 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.219793 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.219922 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] federation.caching = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.220167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.220785 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.220916 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.221051 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.221347 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.221482 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.221642 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.221780 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.221921 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.222060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.222255 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.222394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.222519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.222648 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.222777 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.222916 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.223045 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] identity.caching = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.223173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.223302 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.223430 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.223557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.223771 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.223907 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.224036 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] identity.caching = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.224164 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.224292 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.224421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.224562 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.224692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.224820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.224949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.225077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.225214 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.225349 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.225489 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.225637 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.225764 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.225892 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.226033 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.226163 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.226291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.226420 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.226549 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.226677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.226813 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.226943 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.227071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.227206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.227341 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.227467 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.227600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.227725 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.227849 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.227973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.228098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.228223 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.228356 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.228482 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.228607 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.228731 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.228861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.228996 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.229129 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.229255 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.229379 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.229503 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.229675 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.229800 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.229940 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.230070 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.230199 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.230327 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.230454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.230581 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.230718 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.230859 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.230988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.231122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.231252 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.231379 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.231515 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.231644 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.231774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.231902 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.232029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.232157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.232293 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.232420 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.232548 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.232686 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.232815 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.232943 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.233079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.233207 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.233337 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.233420 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.233611 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.233739 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.233880 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.234009 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.234138 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.234266 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.234400 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.234529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.234665 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.234795 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.234924 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.235052 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.235181 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.235310 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.235447 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.235576 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.235798 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.236745 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.236925 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.237093 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.237208 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.237382 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.237558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.user = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.237772 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.237904 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.238034 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.238174 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.238304 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.238440 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.238440 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.238684 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.user = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.238825 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.238955 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.239094 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.239243 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.239368 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.239498 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.239636 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.239766 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.239895 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.240024 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.240153 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.240281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.240438 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.240565 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.240692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.240775 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.240947 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.241076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.241222 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.241346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.241474 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.241622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.241761 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.241888 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.242021 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.242148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.242273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.242398 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.242523 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.242648 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.242791 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.242917 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.243042 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.243167 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.243292 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.243416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.243548 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.243676 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.243801 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.243927 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.244058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.244183 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.244316 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.244458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.244584 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.244711 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.244711 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.244947 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.245081 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.245081 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.245316 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.245441 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.245441 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.245695 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.245835 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.245835 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.246085 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.246222 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.246350 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.246477 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.246613 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.246743 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.246871 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.247000 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.247128 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.247257 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.247392 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.247521 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.247649 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] resource.caching = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.247778 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] resource.caching = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.247906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.248044 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.248180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.248310 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.248438 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.248565 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.248692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.248821 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.248957 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.249086 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.249214 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.249342 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.249342 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.249600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.249804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.249944 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.250071 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.250196 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.250321 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] role.caching = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.250446 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] role.caching = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.250579 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] role.driver = sql {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.250705 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] role.driver = sql {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.250829 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.250954 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.251079 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.251212 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.251427 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.251561 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.251704 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.251828 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.251954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.252080 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.252252 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.252427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.252557 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.252683 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.252809 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.252944 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.253070 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.253196 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.253323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.253448 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.253618 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.253757 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.253887 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.254017 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.254146 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.254277 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.254407 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.254544 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.254673 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.254801 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.254929 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.255057 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.255185 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.255340 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.255472 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.255601 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.255729 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.255858 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.255987 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.256124 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.256253 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.256390 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.256519 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.256648 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.256776 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.256913 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.257053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.257182 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.257310 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.257441 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.257569 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.257728 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.257856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.257981 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.258105 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.258230 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.258363 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.258490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.258615 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.258748 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.258873 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.258998 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.259130 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.259256 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.259380 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.259506 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.259632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] token.caching = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.259756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] token.caching = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.259888 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.260013 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.260138 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.260262 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.260386 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.260521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.260656 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.260782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.260907 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.261030 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.261159 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.261283 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.261416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.261542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.261709 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.261830 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.261958 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.262087 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.262234 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.262363 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.262491 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.262620 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.262748 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.262876 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.263011 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.263140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.263268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.263396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.263560 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.263691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.263829 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.263958 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.264096 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.264225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.264308 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] database.connection = **** {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.264427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] database.connection = **** {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.264566 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.264704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.264835 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.264972 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.265102 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.265230 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.265359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.265487 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.265633 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.265788 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.265932 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.266064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.266194 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.266324 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.266454 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.266592 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.266724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.266854 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.267584 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.267726 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.267865 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.268066 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.268458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.268589 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.268731 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.268863 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.268995 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.269134 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.269266 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.269396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.269526 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.269687 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.269820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.269961 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.270094 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.270224 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:46:38.270354 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 22:46:38.270495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93656) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 22:46:38.288271 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.288499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.288637 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.288769 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.288901 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.289030 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.297058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.297199 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.327351 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.327601 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.327734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.327887 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.380367 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.380677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.431103 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.431344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.431496 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.431631 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.496944 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.497180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.497321 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.497482 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.497721 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.497860 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.497997 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.498126 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.498266 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.498395 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.498523 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.498523 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.521906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.522133 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.522221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.522356 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.522463 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.522575 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.522692 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.522838 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.522921 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.522996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.523121 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.523206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.523338 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.523555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.534134 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.534543 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.546790 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.547462 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.547603 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.547711 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.547794 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.547864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.547941 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.548017 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.548091 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.549314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.549402 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.549478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93656) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.549771 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.549771 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93655) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:46:38.567351 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.567557 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 22:46:38.567895 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.568094 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 22:46:38.568181 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.568360 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 22:46:38.568445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.568619 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.568700 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.568878 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.568963 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 22:46:38.569131 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.569212 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.569394 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.569684 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.569941 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.578949 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.579225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.579654 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/<string:protocol_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.579779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.579879 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers/<string:idp_id>/protocols/<string:protocol_id>/websso' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.580057 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.580324 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/<string:protocol_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.580602 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers/<string:idp_id>/protocols/<string:protocol_id>/websso' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.588706 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/<string:credential_id>] {{(pid=93655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.589445 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/<string:credential_id>] {{(pid=93656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.591694 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/<string:domain_id>] {{(pid=93655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.591973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/config' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.592254 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/config/<string:group>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.592460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/<string:domain_id>] {{(pid=93656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.592557 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/config/<string:group>/<string:option>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.592738 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/config' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.592820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.593027 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/config/<string:group>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.593111 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/<string:group>/default' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.593289 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/<string:group>/<string:option>/default' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.593380 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/config/<string:group>/<string:option>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.593563 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/users/<string:user_id>/roles' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.593669 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.593847 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/<string:group>/default' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.593927 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/users/<string:user_id>/roles/<string:role_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.594117 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/<string:group>/<string:option>/default' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.594201 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/groups/<string:group_id>/roles' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.594382 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/groups/<string:group_id>/roles/<string:role_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.594462 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/users/<string:user_id>/roles' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.594677 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/users/<string:user_id>/roles/<string:role_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.594950 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/groups/<string:group_id>/roles' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.595764 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/groups/<string:group_id>/roles/<string:role_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.618585 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.619686 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.620086 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/<string:endpoint_id>] {{(pid=93655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.620364 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints/<string:endpoint_id>/OS-ENDPOINT-POLICY/policy' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.621186 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/<string:endpoint_id>] {{(pid=93656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.621462 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints/<string:endpoint_id>/OS-ENDPOINT-POLICY/policy' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.625016 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/<string:group_id>] {{(pid=93655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.625298 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups/<string:group_id>/users' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.625597 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups/<string:group_id>/users/<string:user_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.626218 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/<string:group_id>] {{(pid=93656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.626616 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups/<string:group_id>/users' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.627112 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups/<string:group_id>/users/<string:user_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.632450 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/<string:limit_id>] {{(pid=93655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.632687 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.633704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/<string:limit_id>] {{(pid=93656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.633986 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.636946 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/<string:endpoint_group_id>] {{(pid=93655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.637237 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints/<string:endpoint_id>/projects' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.637527 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects/<string:project_id>/endpoints/<string:endpoint_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.637842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects/<string:project_id>/endpoints' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.638070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/<string:endpoint_group_id>] {{(pid=93656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.638157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects/<string:project_id>/endpoint_groups' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.638353 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints/<string:endpoint_id>/projects' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.638490 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups/<string:endpoint_group_id>/endpoints' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.638633 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects/<string:project_id>/endpoints/<string:endpoint_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.638763 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups/<string:endpoint_group_id>/projects' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.639023 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects/<string:project_id>/endpoints' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.639106 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups/<string:endpoint_group_id>/projects/<string:project_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.639300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects/<string:project_id>/endpoint_groups' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.639576 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups/<string:endpoint_group_id>/endpoints' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.639846 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups/<string:endpoint_group_id>/projects' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.640114 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups/<string:endpoint_group_id>/projects/<string:project_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.655248 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.655524 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers/<string:idp_id>/protocols/<string:protocol_id>/auth' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.656176 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.656455 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers/<string:idp_id>/protocols/<string:protocol_id>/auth' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.660034 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/<string:idp_id>] {{(pid=93655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.660929 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/<string:idp_id>] {{(pid=93656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.663291 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers/<string:idp_id>/protocols/<string:protocol_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.663596 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers/<string:idp_id>/protocols' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.664068 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers/<string:idp_id>/protocols/<string:protocol_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.664478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers/<string:idp_id>/protocols' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.668101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/<string:mapping_id>] {{(pid=93655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.668781 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/<string:mapping_id>] {{(pid=93656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.671303 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/<string:sp_id>] {{(pid=93655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.672002 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/<string:sp_id>] {{(pid=93656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.675151 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/groups/<string:group_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.675446 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/groups/<string:group_id>/roles/inherited_to_projects' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.675730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/users/<string:user_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.675814 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/groups/<string:group_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.676017 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/users/<string:user_id>/roles/inherited_to_projects' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.676114 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/groups/<string:group_id>/roles/inherited_to_projects' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.676297 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects/<string:project_id>/users/<string:user_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.676380 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/users/<string:user_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.676687 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects/<string:project_id>/groups/<string:group_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.676771 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/users/<string:user_id>/roles/inherited_to_projects' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.676985 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects/<string:project_id>/users/<string:user_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.677274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects/<string:project_id>/groups/<string:group_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.692952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/<string:consumer_id>] {{(pid=93655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.693233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.693495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/<string:consumer_id>] {{(pid=93656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.693614 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.693784 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/<string:request_token_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.693868 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.694059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.694324 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/<string:request_token_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.700692 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.701236 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.702447 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.702733 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.702954 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.703229 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.705572 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/<string:policy_id>] {{(pid=93655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.705865 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.706146 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/endpoints/<string:endpoint_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.706228 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/<string:policy_id>] {{(pid=93656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.706436 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/services/<string:service_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.706521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.706716 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/services/<string:service_id>/regions/<string:region_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.706803 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/endpoints/<string:endpoint_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.707031 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/services/<string:service_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.707312 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/services/<string:service_id>/regions/<string:region_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.718559 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/<string:project_id>] {{(pid=93655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.718824 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/<string:project_id>] {{(pid=93656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.718923 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/tags' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.719104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/tags' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.719187 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/tags/<string:value>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.719379 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/users/<string:user_id>/roles/<string:role_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.719462 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/tags/<string:value>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.719655 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/users/<string:user_id>/roles/<string:role_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.719737 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/users/<string:user_id>/roles' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.719924 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/groups/<string:group_id>/roles/<string:role_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.720551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/users/<string:user_id>/roles' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.720737 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/groups/<string:group_id>/roles/<string:role_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.720855 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/groups/<string:group_id>/roles' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.721010 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/groups/<string:group_id>/roles' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.737286 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/<string:region_id>] {{(pid=93655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.738024 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/<string:region_id>] {{(pid=93656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.740401 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/<string:registered_limit_id>] {{(pid=93655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.741117 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/<string:registered_limit_id>] {{(pid=93656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.744500 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.745110 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.746015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.746633 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.747529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/<string:role_id>] {{(pid=93655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.747808 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles/<string:prior_role_id>/implies' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.748098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles/<string:prior_role_id>/implies/<string:implied_role_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.748182 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/<string:role_id>] {{(pid=93656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.748388 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles/<string:prior_role_id>/implies' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.748669 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles/<string:prior_role_id>/implies/<string:implied_role_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.857532 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.857827 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.859068 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/<string:service_id>] {{(pid=93656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.859356 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/<string:service_id>] {{(pid=93655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.862567 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users/<string:user_id>/roles' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.862854 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users/<string:user_id>/roles/<string:role_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.862940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users/<string:user_id>/roles' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.863138 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups/<string:group_id>/roles' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.863222 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users/<string:user_id>/roles/<string:role_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.863412 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups/<string:group_id>/roles/<string:role_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.863499 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups/<string:group_id>/roles' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.863709 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups/<string:group_id>/roles/<string:role_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.871413 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/<string:trust_id>] {{(pid=93656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.871699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/<string:trust_id>] {{(pid=93655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.871799 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts/<string:trust_id>/roles' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.871976 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts/<string:trust_id>/roles/<string:role_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.872060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts/<string:trust_id>/roles' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.872253 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts/<string:trust_id>/roles/<string:role_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.879251 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/<string:user_id>] {{(pid=93656) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.879402 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/<string:user_id>] {{(pid=93655) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:46:38.879528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/password' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.879646 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/password' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.879807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/groups' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.879938 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/groups' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.880083 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/projects' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.880217 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/projects' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.880356 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/credentials/OS-EC2' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.880492 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/credentials/OS-EC2' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.880632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/credentials/OS-EC2/<string:credential_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.880771 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/credentials/OS-EC2/<string:credential_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.880902 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.881043 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.881174 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens/<string:access_token_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.881319 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens/<string:access_token_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.881459 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens/<string:access_token_id>/roles' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.881626 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens/<string:access_token_id>/roles' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.881739 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens/<string:access_token_id>/roles/<string:role_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.881900 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens/<string:access_token_id>/roles/<string:role_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.881997 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/application_credentials' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.882172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/application_credentials' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.882256 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/application_credentials/<string:application_credential_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.882445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/application_credentials/<string:application_credential_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.882569 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/access_rules' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.882711 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/access_rules' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.882794 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/access_rules/<string:access_rule_id>' {}] {{(pid=93656) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.882971 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/access_rules/<string:access_rule_id>' {}] {{(pid=93655) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:46:38.917108 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557357adf9c0 pid: 93656 (default app) Jul 25 22:46:38.917217 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557357adf9c0 pid: 93655 (default app) Jul 25 22:46:38.920705 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8968e63-5d8d-4247-a01d-7f4f45a65d27 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:38.921000 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8968e63-5d8d-4247-a01d-7f4f45a65d27 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:38.921283 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8968e63-5d8d-4247-a01d-7f4f45a65d27 None None] PATH_INFO: `/v3` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:38.926236 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 791 bytes} [Mon Jul 25 22:46:38 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:47.009777 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0a5d4-4f34-4247-bc39-b3825dadd37d None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:47.010343 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0a5d4-4f34-4247-bc39-b3825dadd37d None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:47.010343 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0a5d4-4f34-4247-bc39-b3825dadd37d None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:47.014626 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 1/2] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:46:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:47.020690 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7740db-9300-47e2-af15-2266bb18517b None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:47.021079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7740db-9300-47e2-af15-2266bb18517b None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:47.021245 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7740db-9300-47e2-af15-2266bb18517b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:47.098389 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: INFO dbcounter [None req-8b7740db-9300-47e2-af15-2266bb18517b None None] Registered counter for database keystone Jul 25 22:46:47.119391 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG oslo_db.sqlalchemy.engines [None req-8b7740db-9300-47e2-af15-2266bb18517b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93656) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 22:46:47.125497 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writer thread running {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 22:46:47.302755 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG passlib.handlers.bcrypt [None req-8b7740db-9300-47e2-af15-2266bb18517b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93656) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 22:46:47.303080 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG passlib.handlers.bcrypt [None req-8b7740db-9300-47e2-af15-2266bb18517b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93656) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 22:46:47.357247 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-8b7740db-9300-47e2-af15-2266bb18517b None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:47.358892 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-8b7740db-9300-47e2-af15-2266bb18517b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:47.486096 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 22:46:47.670492 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0a5d4-4f34-4247-bc39-b3825dadd37d None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:47.747281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: INFO dbcounter [None req-7bd0a5d4-4f34-4247-bc39-b3825dadd37d None None] Registered counter for database keystone Jul 25 22:46:47.766324 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG oslo_db.sqlalchemy.engines [None req-7bd0a5d4-4f34-4247-bc39-b3825dadd37d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 22:46:47.772764 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writer thread running {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 22:46:47.891947 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0a5d4-4f34-4247-bc39-b3825dadd37d None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:47.896795 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bf229-61e1-48f8-b387-aa5b26c074ea admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=13Bd3UxQRsum6l1rvFLsSQ, audit_chain_id=['13Bd3UxQRsum6l1rvFLsSQ']) at 0x7f8a14d4db80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:47.897444 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bf229-61e1-48f8-b387-aa5b26c074ea admin admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:47.897768 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bf229-61e1-48f8-b387-aa5b26c074ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:47.898049 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bf229-61e1-48f8-b387-aa5b26c074ea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:47.906654 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4bf229-61e1-48f8-b387-aa5b26c074ea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:47.959039 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ba4bf229-61e1-48f8-b387-aa5b26c074ea admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 22:46:47.959324 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4bf229-61e1-48f8-b387-aa5b26c074ea admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:47.968818 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1324 bytes} [Mon Jul 25 22:46:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:46:47.975816 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7740db-9300-47e2-af15-2266bb18517b None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:47.990516 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7740db-9300-47e2-af15-2266bb18517b None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:47.994905 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088e0de-0361-4757-95ec-062f28ddc86c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=13Bd3UxQRsum6l1rvFLsSQ, audit_chain_id=['13Bd3UxQRsum6l1rvFLsSQ']) at 0x7f8a14dd0910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:47.996013 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088e0de-0361-4757-95ec-062f28ddc86c admin admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:47.996302 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088e0de-0361-4757-95ec-062f28ddc86c admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:47.996582 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088e0de-0361-4757-95ec-062f28ddc86c admin admin] PATH_INFO: `/v3/projects/bbcbafb1154a42cbb08b02e29c87618d` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:47.998093 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088e0de-0361-4757-95ec-062f28ddc86c admin admin] RBAC: Authorizing `identity:get_project(project_id=bbcbafb1154a42cbb08b02e29c87618d)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:48.049226 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5088e0de-0361-4757-95ec-062f28ddc86c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 22:46:48.049808 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088e0de-0361-4757-95ec-062f28ddc86c admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:48.054213 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 3/5] 10.222.0.47 () {56 vars in 1207 bytes} [Mon Jul 25 22:46:47 2022] GET /identity/v3/projects/bbcbafb1154a42cbb08b02e29c87618d => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:46:50.244200 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb54d2-c60e-4645-beb8-86d21a744ec8 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:50.244763 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb54d2-c60e-4645-beb8-86d21a744ec8 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:50.244763 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb54d2-c60e-4645-beb8-86d21a744ec8 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:50.249073 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 3/6] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:46:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:46:50.256508 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb3c99-a178-4fc3-8c75-8f1cdcdcdffd None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:50.257063 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb3c99-a178-4fc3-8c75-8f1cdcdcdffd None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:50.257063 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb3c99-a178-4fc3-8c75-8f1cdcdcdffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:50.279114 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-7beb3c99-a178-4fc3-8c75-8f1cdcdcdffd None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:50.280710 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-7beb3c99-a178-4fc3-8c75-8f1cdcdcdffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:50.289808 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 25 22:46:50.313261 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb54d2-c60e-4645-beb8-86d21a744ec8 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:50.325457 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb54d2-c60e-4645-beb8-86d21a744ec8 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:50.330408 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d786c-186a-493a-9826-927f95a56a55 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=s-XLxoidTEa2Z4DLzyQFMA, audit_chain_id=['s-XLxoidTEa2Z4DLzyQFMA']) at 0x7f8a142875e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:50.331020 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d786c-186a-493a-9826-927f95a56a55 admin admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:50.331312 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d786c-186a-493a-9826-927f95a56a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:50.331597 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d786c-186a-493a-9826-927f95a56a55 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:50.339308 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d786c-186a-493a-9826-927f95a56a55 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:50.341139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d786c-186a-493a-9826-927f95a56a55 admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:50.350541 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1324 bytes} [Mon Jul 25 22:46:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:46:50.355865 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb3c99-a178-4fc3-8c75-8f1cdcdcdffd None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:50.365016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb3c99-a178-4fc3-8c75-8f1cdcdcdffd None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:50.369429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06ae59-1fa1-4a25-8452-c668c7ad6525 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=s-XLxoidTEa2Z4DLzyQFMA, audit_chain_id=['s-XLxoidTEa2Z4DLzyQFMA']) at 0x7f8a14dd0af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:50.370107 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06ae59-1fa1-4a25-8452-c668c7ad6525 admin admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:50.370395 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06ae59-1fa1-4a25-8452-c668c7ad6525 admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:50.370674 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06ae59-1fa1-4a25-8452-c668c7ad6525 admin admin] PATH_INFO: `/v3/users/21915d6d53c54080a8c4d15c72508181` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:50.372058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06ae59-1fa1-4a25-8452-c668c7ad6525 admin admin] RBAC: Authorizing `identity:get_user(user_id=21915d6d53c54080a8c4d15c72508181)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:50.373943 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06ae59-1fa1-4a25-8452-c668c7ad6525 admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:50.375497 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 5/9] 10.222.0.47 () {56 vars in 1198 bytes} [Mon Jul 25 22:46:50 2022] GET /identity/v3/users/21915d6d53c54080a8c4d15c72508181 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:52.671465 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492211a-d43f-4370-b562-512e18abca8e None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:52.672006 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492211a-d43f-4370-b562-512e18abca8e None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:52.672006 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492211a-d43f-4370-b562-512e18abca8e None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:52.673390 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 5/10] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:52.678825 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61f962-525f-48c0-abb8-c3b755d9e958 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:52.679281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61f962-525f-48c0-abb8-c3b755d9e958 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:52.679509 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f61f962-525f-48c0-abb8-c3b755d9e958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:52.682526 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995ae85-7392-468f-8df8-ffc3fd1a9b65 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:52.682820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995ae85-7392-468f-8df8-ffc3fd1a9b65 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:52.683104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995ae85-7392-468f-8df8-ffc3fd1a9b65 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:52.684353 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 6/11] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:46:52.689216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a54b47-3340-42b1-b7ce-96785bb5b89b None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:52.689503 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a54b47-3340-42b1-b7ce-96785bb5b89b None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:52.689815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a54b47-3340-42b1-b7ce-96785bb5b89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:52.699041 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-4f61f962-525f-48c0-abb8-c3b755d9e958 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:52.700231 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-4f61f962-525f-48c0-abb8-c3b755d9e958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:52.732577 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG passlib.handlers.bcrypt [None req-47a54b47-3340-42b1-b7ce-96785bb5b89b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93655) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 22:46:52.732919 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG passlib.handlers.bcrypt [None req-47a54b47-3340-42b1-b7ce-96785bb5b89b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93655) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 22:46:52.779401 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-47a54b47-3340-42b1-b7ce-96785bb5b89b None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:52.780157 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 6/12] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:46:52.781001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-47a54b47-3340-42b1-b7ce-96785bb5b89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:52.804131 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61f962-525f-48c0-abb8-c3b755d9e958 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:52.827637 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:52.883485 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 7/13] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:46:52.907567 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a54b47-3340-42b1-b7ce-96785bb5b89b None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:52.911189 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f61f962-525f-48c0-abb8-c3b755d9e958 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:52.945748 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd5569-3295-4069-b054-40b2efd97527 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Xcxlki12RcuH0T7m82jm6Q, audit_chain_id=['Xcxlki12RcuH0T7m82jm6Q']) at 0x7f8a14195910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:52.946397 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd5569-3295-4069-b054-40b2efd97527 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:52.946682 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd5569-3295-4069-b054-40b2efd97527 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:52.946959 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd5569-3295-4069-b054-40b2efd97527 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:52.958897 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd5569-3295-4069-b054-40b2efd97527 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:46:52.967726 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-46dd5569-3295-4069-b054-40b2efd97527 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:52.967726 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:52.967726 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:52.967726 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:52.967726 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:52.967726 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:52.967726 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:52.967726 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:52.967726 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:52.967726 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:52.967726 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:52.967726 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:52.967726 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:46:52.967726 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:46:52.967726 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:46:52.967726 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:46:52.968632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:46:52.968632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:46:52.968632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:46:52.968632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:46:52.968632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:52.968632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:52.968632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:52.968632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:52.968632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:52.968632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:52.968632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:52.968632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:52.968632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:52.968632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:52.968632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:52.968632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:52.970285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:52.970285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:52.970285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:52.970285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:52.970285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:46:52.970285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:46:52.970285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:46:52.970285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:46:52.970285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:46:52.970285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:46:52.970285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:52.970285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:46:52.970285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 7/14] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 22:46:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:46:52.974740 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd5569-3295-4069-b054-40b2efd97527 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:53.011464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a54b47-3340-42b1-b7ce-96785bb5b89b None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:53.013772 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:53.050640 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f0d80-ebc5-44b1-86b9-8145409e4559 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ay2g4YLsRCCCrktwyop8Rw, audit_chain_id=['ay2g4YLsRCCCrktwyop8Rw']) at 0x7f8a14d54f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:53.051501 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f0d80-ebc5-44b1-86b9-8145409e4559 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:53.051796 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f0d80-ebc5-44b1-86b9-8145409e4559 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:53.052072 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f0d80-ebc5-44b1-86b9-8145409e4559 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:53.056528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:53.075692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd5569-3295-4069-b054-40b2efd97527 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:53.109945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19376d-78d5-47db-b941-94258a7fd69f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Xcxlki12RcuH0T7m82jm6Q, audit_chain_id=['Xcxlki12RcuH0T7m82jm6Q']) at 0x7f8a140cc8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:53.110880 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19376d-78d5-47db-b941-94258a7fd69f None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:53.111155 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19376d-78d5-47db-b941-94258a7fd69f None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:53.111422 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19376d-78d5-47db-b941-94258a7fd69f None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:53.112138 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19376d-78d5-47db-b941-94258a7fd69f None admin] RBAC: Adding query filter params (name=admin) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:53.112441 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19376d-78d5-47db-b941-94258a7fd69f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:53.113857 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19376d-78d5-47db-b941-94258a7fd69f None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:53.120819 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f0d80-ebc5-44b1-86b9-8145409e4559 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:53.122377 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917f0d80-ebc5-44b1-86b9-8145409e4559 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:53.126026 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 8/15] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:46:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:46:53.131748 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19376d-78d5-47db-b941-94258a7fd69f None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:53.222200 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 8/16] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:46:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:46:53.227810 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f0d80-ebc5-44b1-86b9-8145409e4559 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:53.230531 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:53.235615 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19376d-78d5-47db-b941-94258a7fd69f None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:53.270452 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380a9cc-f697-4264-b8b3-4e1db8c0e1e1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Xcxlki12RcuH0T7m82jm6Q, audit_chain_id=['Xcxlki12RcuH0T7m82jm6Q']) at 0x7f8a140d15e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:53.271021 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380a9cc-f697-4264-b8b3-4e1db8c0e1e1 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:53.271303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380a9cc-f697-4264-b8b3-4e1db8c0e1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:53.271574 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380a9cc-f697-4264-b8b3-4e1db8c0e1e1 None admin] PATH_INFO: `/v3/users/21915d6d53c54080a8c4d15c72508181` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:53.272749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380a9cc-f697-4264-b8b3-4e1db8c0e1e1 None admin] RBAC: Authorizing `identity:get_user(user_id=21915d6d53c54080a8c4d15c72508181)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:53.274255 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380a9cc-f697-4264-b8b3-4e1db8c0e1e1 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:53.275817 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 9/17] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:46:53 2022] GET /identity/v3/users/21915d6d53c54080a8c4d15c72508181 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:46:53.281356 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380a9cc-f697-4264-b8b3-4e1db8c0e1e1 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:53.296625 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:53.330961 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f0d80-ebc5-44b1-86b9-8145409e4559 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:53.366777 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762f151-290d-44fd-84de-6a6f74ea663e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ay2g4YLsRCCCrktwyop8Rw, audit_chain_id=['ay2g4YLsRCCCrktwyop8Rw']) at 0x7f8a14288430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:53.367627 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762f151-290d-44fd-84de-6a6f74ea663e None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:53.367920 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762f151-290d-44fd-84de-6a6f74ea663e None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:53.368198 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762f151-290d-44fd-84de-6a6f74ea663e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:53.382918 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380a9cc-f697-4264-b8b3-4e1db8c0e1e1 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:53.388359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762f151-290d-44fd-84de-6a6f74ea663e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:53.389849 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762f151-290d-44fd-84de-6a6f74ea663e None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:53.407820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-4762f151-290d-44fd-84de-6a6f74ea663e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:46:53.407820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:53.407820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:53.407820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:53.407820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:53.407820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:53.407820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:53.407820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:53.407820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:53.407820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:53.407820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:53.407820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:53.407820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:46:53.407820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:46:53.407820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:46:53.408634 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:46:53.408634 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:53.408634 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:53.408634 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:53.408634 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:53.408634 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:53.408634 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:53.408634 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:53.408634 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:53.408634 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:53.408634 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:53.408634 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:53.408634 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:53.408634 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:53.408634 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:53.408634 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:53.408634 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:53.409428 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:46:53.409428 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:46:53.409428 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:46:53.409428 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:46:53.409428 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 9/18] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:46:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:46:53.415469 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762f151-290d-44fd-84de-6a6f74ea663e None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:53.416847 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d9587-2e12-4e01-a2e1-e5f41e2dc344 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Xcxlki12RcuH0T7m82jm6Q, audit_chain_id=['Xcxlki12RcuH0T7m82jm6Q']) at 0x7f8a0ffdadc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:53.417499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d9587-2e12-4e01-a2e1-e5f41e2dc344 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:53.417846 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d9587-2e12-4e01-a2e1-e5f41e2dc344 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:53.418128 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d9587-2e12-4e01-a2e1-e5f41e2dc344 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:53.419287 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d9587-2e12-4e01-a2e1-e5f41e2dc344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:53.420857 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86d9587-2e12-4e01-a2e1-e5f41e2dc344 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:53.422987 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 10/19] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:46:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:46:53.428855 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d9587-2e12-4e01-a2e1-e5f41e2dc344 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:53.471954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:53.511498 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:53.518335 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762f151-290d-44fd-84de-6a6f74ea663e None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:53.533085 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d9587-2e12-4e01-a2e1-e5f41e2dc344 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:53.553472 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc6063-10ad-4e77-8da3-2d32a60f025c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ay2g4YLsRCCCrktwyop8Rw, audit_chain_id=['ay2g4YLsRCCCrktwyop8Rw']) at 0x7f8a14213ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:53.554128 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc6063-10ad-4e77-8da3-2d32a60f025c None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:53.554410 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc6063-10ad-4e77-8da3-2d32a60f025c None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:53.554712 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc6063-10ad-4e77-8da3-2d32a60f025c None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:53.555402 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc6063-10ad-4e77-8da3-2d32a60f025c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:53.555708 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc6063-10ad-4e77-8da3-2d32a60f025c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:53.557406 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc6063-10ad-4e77-8da3-2d32a60f025c None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:53.567585 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b0af1-fc56-460c-86bf-c6ca13d47c97 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Xcxlki12RcuH0T7m82jm6Q, audit_chain_id=['Xcxlki12RcuH0T7m82jm6Q']) at 0x7f8a140b99d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:53.568210 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b0af1-fc56-460c-86bf-c6ca13d47c97 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:53.568494 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b0af1-fc56-460c-86bf-c6ca13d47c97 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:53.568769 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b0af1-fc56-460c-86bf-c6ca13d47c97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:53.569556 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b0af1-fc56-460c-86bf-c6ca13d47c97 None admin] RBAC: Adding query filter params (role.id=6ca03befbf3a456eae350bc7e583488f, scope.domain.id=default, user.id=21915d6d53c54080a8c4d15c72508181) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:53.569893 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b0af1-fc56-460c-86bf-c6ca13d47c97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:53.571353 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b0af1-fc56-460c-86bf-c6ca13d47c97 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:53.575373 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 10/20] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:46:53.578689 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 11/21] 10.222.0.47 () {56 vars in 1322 bytes} [Mon Jul 25 22:46:53 2022] GET /identity/v3/role_assignments?user.id=21915d6d53c54080a8c4d15c72508181&scope.domain.id=default&role.id=6ca03befbf3a456eae350bc7e583488f => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:46:56.206280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e5132-4fd2-4253-8a67-35f134d95f6f None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:56.207380 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e5132-4fd2-4253-8a67-35f134d95f6f None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:56.207864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e5132-4fd2-4253-8a67-35f134d95f6f None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:56.209405 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 11/22] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:46:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:56.215044 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bc3c1-1fee-4c0b-af6b-01b3919bff0f None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:56.216007 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bc3c1-1fee-4c0b-af6b-01b3919bff0f None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:56.216517 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bc3c1-1fee-4c0b-af6b-01b3919bff0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:56.246211 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-510bc3c1-1fee-4c0b-af6b-01b3919bff0f None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:56.247463 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-510bc3c1-1fee-4c0b-af6b-01b3919bff0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:56.284559 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f856eb-5961-4578-b8a5-1214c9fce34f None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:56.285166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f856eb-5961-4578-b8a5-1214c9fce34f None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:56.285698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f856eb-5961-4578-b8a5-1214c9fce34f None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:56.287228 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 12/23] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:46:56.299618 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547a565-d9cd-46b6-8e60-654218d0ec10 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:56.300227 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547a565-d9cd-46b6-8e60-654218d0ec10 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:56.300711 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547a565-d9cd-46b6-8e60-654218d0ec10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:56.338511 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 12/24] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:46:56.339330 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-0547a565-d9cd-46b6-8e60-654218d0ec10 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:56.340746 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-0547a565-d9cd-46b6-8e60-654218d0ec10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:56.379475 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bc3c1-1fee-4c0b-af6b-01b3919bff0f None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:56.540917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:56.561524 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 13/25] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:46:56.604025 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547a565-d9cd-46b6-8e60-654218d0ec10 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:56.609748 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bc3c1-1fee-4c0b-af6b-01b3919bff0f None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:56.675187 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7eede-5b12-4e1d-b06d-faa5bca52257 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zfpXFcudQZS2MFxJMALFxQ, audit_chain_id=['zfpXFcudQZS2MFxJMALFxQ']) at 0x7f8a140ccc10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:56.675855 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7eede-5b12-4e1d-b06d-faa5bca52257 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:56.676145 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7eede-5b12-4e1d-b06d-faa5bca52257 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:56.676421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7eede-5b12-4e1d-b06d-faa5bca52257 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:56.699718 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7eede-5b12-4e1d-b06d-faa5bca52257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:46:56.705782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-bbb7eede-5b12-4e1d-b06d-faa5bca52257 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:56.705782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:56.705782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:56.705782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:56.705782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:56.705782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:56.705782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:56.705782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:56.705782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:56.705782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:56.705782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:56.705782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:56.705782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:46:56.705782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:46:56.705782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:46:56.705782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:46:56.706660 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:46:56.706660 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:46:56.706660 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:46:56.706660 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:46:56.706660 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:56.706660 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:56.706660 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:56.706660 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:56.706660 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:56.706660 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:56.706660 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:56.706660 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:56.706660 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:56.706660 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:56.706660 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:56.706660 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:56.707420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:56.707420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:56.707420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:56.707420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:56.707420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:46:56.707420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:46:56.707420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:46:56.707420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:46:56.707420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:46:56.707420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:46:56.707420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:46:56.707420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:46:56.708620 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:56.708689 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 13/26] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 22:46:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:46:56.719170 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7eede-5b12-4e1d-b06d-faa5bca52257 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:56.858720 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547a565-d9cd-46b6-8e60-654218d0ec10 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:56.916851 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7eede-5b12-4e1d-b06d-faa5bca52257 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:56.934803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb546b1-1fae-49ee-9573-f030dedcee58 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wFDvcvMcSZWaETtocvS9uA, audit_chain_id=['wFDvcvMcSZWaETtocvS9uA']) at 0x7f8a14284d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:56.935465 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb546b1-1fae-49ee-9573-f030dedcee58 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:56.935751 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb546b1-1fae-49ee-9573-f030dedcee58 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:56.936121 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb546b1-1fae-49ee-9573-f030dedcee58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:56.961708 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb546b1-1fae-49ee-9573-f030dedcee58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:56.963211 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb546b1-1fae-49ee-9573-f030dedcee58 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:56.979159 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef15792-729b-478f-8114-ce6dbfd28f88 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zfpXFcudQZS2MFxJMALFxQ, audit_chain_id=['zfpXFcudQZS2MFxJMALFxQ']) at 0x7f8a0ff8c2b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:56.980232 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef15792-729b-478f-8114-ce6dbfd28f88 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:56.980746 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef15792-729b-478f-8114-ce6dbfd28f88 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:56.981187 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef15792-729b-478f-8114-ce6dbfd28f88 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:56.982103 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef15792-729b-478f-8114-ce6dbfd28f88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:56.982553 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef15792-729b-478f-8114-ce6dbfd28f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:56.984286 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef15792-729b-478f-8114-ce6dbfd28f88 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:56.986184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-feb546b1-1fae-49ee-9573-f030dedcee58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:46:56.986184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:46:56.986184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:46:56.986184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:46:56.986184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:46:56.986184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:46:56.986184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:46:56.986184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:46:56.986184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:46:56.986184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:46:56.986184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:46:56.986184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:46:56.986184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:46:56.986184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:46:56.986184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:46:56.987166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:46:56.987166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:46:56.987166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:46:56.987166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:46:56.987166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:46:56.987166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:46:56.987166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:46:56.987166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:46:56.987166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:46:56.987166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:46:56.987166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:46:56.987166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:46:56.987166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:46:56.987166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:46:56.987166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:46:56.987166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:46:56.987166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:46:56.988195 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:46:56.988195 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:46:56.988195 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:46:56.988195 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:46:56.988195 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 14/27] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:46:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:46:56.988733 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c8c80-fad2-41c3-b77e-43d699454f04 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:56.988832 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c8c80-fad2-41c3-b77e-43d699454f04 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:56.993606 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:56.993738 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c8c80-fad2-41c3-b77e-43d699454f04 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:56.993738 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 15/28] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:56.993738 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0b2c8-98a5-44e4-8b69-e3a21aa96baf None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:56.993738 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0b2c8-98a5-44e4-8b69-e3a21aa96baf None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:56.993738 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0b2c8-98a5-44e4-8b69-e3a21aa96baf None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:56.996219 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 16/29] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:56.996943 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0b2c8-98a5-44e4-8b69-e3a21aa96baf None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:57.003218 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 14/30] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:46:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:46:57.010908 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546de410-9389-46cf-b014-5d32b1a54a7f None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:57.011232 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546de410-9389-46cf-b014-5d32b1a54a7f None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:57.011513 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546de410-9389-46cf-b014-5d32b1a54a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:57.031115 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-546de410-9389-46cf-b014-5d32b1a54a7f None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:57.033164 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-546de410-9389-46cf-b014-5d32b1a54a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:57.105149 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 15/31] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:46:57.106545 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee735acf-aca1-4307-ad07-37757a64602b None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:57.106939 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee735acf-aca1-4307-ad07-37757a64602b None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:57.107221 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee735acf-aca1-4307-ad07-37757a64602b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:57.110622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:57.115539 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0b2c8-98a5-44e4-8b69-e3a21aa96baf None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:57.130244 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-ee735acf-aca1-4307-ad07-37757a64602b None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:57.131434 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-ee735acf-aca1-4307-ad07-37757a64602b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:57.162222 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c51d3-44d8-47b3-8b1c-1434fd417525 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wFDvcvMcSZWaETtocvS9uA, audit_chain_id=['wFDvcvMcSZWaETtocvS9uA']) at 0x7f8a1408b6d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:57.163175 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c51d3-44d8-47b3-8b1c-1434fd417525 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:57.163470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c51d3-44d8-47b3-8b1c-1434fd417525 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:57.163755 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c51d3-44d8-47b3-8b1c-1434fd417525 None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:57.164750 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c51d3-44d8-47b3-8b1c-1434fd417525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:46:57.165063 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c51d3-44d8-47b3-8b1c-1434fd417525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:57.166973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c51d3-44d8-47b3-8b1c-1434fd417525 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:57.181230 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 17/32] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:57.183702 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c51d3-44d8-47b3-8b1c-1434fd417525 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:57.210965 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 16/33] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:46:57.211798 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee735acf-aca1-4307-ad07-37757a64602b None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:57.276671 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:57.319224 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c51d3-44d8-47b3-8b1c-1434fd417525 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:57.331217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee735acf-aca1-4307-ad07-37757a64602b None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:57.358048 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74243d-0b0c-4560-9a90-5775cbbfea84 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zfpXFcudQZS2MFxJMALFxQ, audit_chain_id=['zfpXFcudQZS2MFxJMALFxQ']) at 0x7f8a14098ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:57.358996 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74243d-0b0c-4560-9a90-5775cbbfea84 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:57.359450 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74243d-0b0c-4560-9a90-5775cbbfea84 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:57.359910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74243d-0b0c-4560-9a90-5775cbbfea84 None admin] PATH_INFO: `/v3/users/21915d6d53c54080a8c4d15c72508181` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:57.361734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74243d-0b0c-4560-9a90-5775cbbfea84 None admin] RBAC: Authorizing `identity:get_user(user_id=21915d6d53c54080a8c4d15c72508181)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:57.363357 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74243d-0b0c-4560-9a90-5775cbbfea84 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:57.365350 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 18/34] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:46:57 2022] GET /identity/v3/users/21915d6d53c54080a8c4d15c72508181 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:57.366324 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74243d-0b0c-4560-9a90-5775cbbfea84 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:57.378300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf8812-a04d-447a-b989-6ffd3b007bc9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SJnp1qPnRAyUEpq33eOlAQ, audit_chain_id=['SJnp1qPnRAyUEpq33eOlAQ']) at 0x7f8a14195760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:57.379028 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf8812-a04d-447a-b989-6ffd3b007bc9 None admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:57.379394 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf8812-a04d-447a-b989-6ffd3b007bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:57.380209 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf8812-a04d-447a-b989-6ffd3b007bc9 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:57.381019 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf8812-a04d-447a-b989-6ffd3b007bc9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:57.383280 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf8812-a04d-447a-b989-6ffd3b007bc9 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:57.403009 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:57.488559 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74243d-0b0c-4560-9a90-5775cbbfea84 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:57.530575 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab1c60-dde9-4e1c-9378-15e392ff7df2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wFDvcvMcSZWaETtocvS9uA, audit_chain_id=['wFDvcvMcSZWaETtocvS9uA']) at 0x7f8a14162250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:57.531436 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab1c60-dde9-4e1c-9378-15e392ff7df2 None admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:57.531799 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab1c60-dde9-4e1c-9378-15e392ff7df2 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:57.532241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab1c60-dde9-4e1c-9378-15e392ff7df2 None admin] PATH_INFO: `/v3/projects` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:57.532921 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 17/35] 10.222.0.47 () {60 vars in 1131 bytes} [Mon Jul 25 22:46:57 2022] POST /identity/v3/roles => generated 225 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:46:57.533029 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab1c60-dde9-4e1c-9378-15e392ff7df2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:57.534339 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf8812-a04d-447a-b989-6ffd3b007bc9 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:57.534890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab1c60-dde9-4e1c-9378-15e392ff7df2 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:57.710486 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 19/36] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Jul 25 22:46:57 2022] POST /identity/v3/projects => generated 301 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:46:57.711630 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab1c60-dde9-4e1c-9378-15e392ff7df2 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:57.758983 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf8812-a04d-447a-b989-6ffd3b007bc9 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:57.781207 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:57.805730 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124cc29-c64a-48a6-a549-026b769eea3b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Tqd9l3ryQ8ma8maPR49cKg, audit_chain_id=['Tqd9l3ryQ8ma8maPR49cKg']) at 0x7f8a140bae80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:57.806775 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124cc29-c64a-48a6-a549-026b769eea3b None admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:57.807308 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124cc29-c64a-48a6-a549-026b769eea3b None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:57.807591 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124cc29-c64a-48a6-a549-026b769eea3b None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:57.808340 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124cc29-c64a-48a6-a549-026b769eea3b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:57.810737 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124cc29-c64a-48a6-a549-026b769eea3b None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:57.816508 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:57.833297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 18/37] 10.222.0.47 () {60 vars in 1131 bytes} [Mon Jul 25 22:46:57 2022] POST /identity/v3/roles => generated 219 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:46:57.835280 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf157a-8775-4af8-8a68-6a26b1dea610 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:57.835787 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf157a-8775-4af8-8a68-6a26b1dea610 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:57.836283 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf157a-8775-4af8-8a68-6a26b1dea610 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:57.842436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 19/38] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:46:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:57.845379 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799ffcb-4b00-431f-9225-0db26a5a0ec3 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:57.846075 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799ffcb-4b00-431f-9225-0db26a5a0ec3 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:57.846564 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799ffcb-4b00-431f-9225-0db26a5a0ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:57.853310 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab1c60-dde9-4e1c-9378-15e392ff7df2 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:57.872525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-3799ffcb-4b00-431f-9225-0db26a5a0ec3 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:57.875898 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-3799ffcb-4b00-431f-9225-0db26a5a0ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:57.907659 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc53fe-3abf-438f-af31-5fdf7c734e62 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zfpXFcudQZS2MFxJMALFxQ, audit_chain_id=['zfpXFcudQZS2MFxJMALFxQ']) at 0x7f8a14202370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:57.908344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc53fe-3abf-438f-af31-5fdf7c734e62 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:57.908626 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc53fe-3abf-438f-af31-5fdf7c734e62 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:57.908905 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc53fe-3abf-438f-af31-5fdf7c734e62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:57.913842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc53fe-3abf-438f-af31-5fdf7c734e62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:57.915581 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc53fe-3abf-438f-af31-5fdf7c734e62 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:57.917402 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 20/39] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:46:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:57.926855 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc53fe-3abf-438f-af31-5fdf7c734e62 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:57.989602 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 20/40] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:46:58.029206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799ffcb-4b00-431f-9225-0db26a5a0ec3 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:58.115363 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc53fe-3abf-438f-af31-5fdf7c734e62 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:58.153735 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799ffcb-4b00-431f-9225-0db26a5a0ec3 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:58.155646 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775862d0-ab16-4706-b31b-6554afd63790 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zfpXFcudQZS2MFxJMALFxQ, audit_chain_id=['zfpXFcudQZS2MFxJMALFxQ']) at 0x7f8a14202f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:58.156465 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775862d0-ab16-4706-b31b-6554afd63790 None admin] REQUEST_METHOD: `PUT` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:58.156756 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775862d0-ab16-4706-b31b-6554afd63790 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:58.157051 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775862d0-ab16-4706-b31b-6554afd63790 None admin] PATH_INFO: `/v3/domains/default/users/21915d6d53c54080a8c4d15c72508181/roles/6ca03befbf3a456eae350bc7e583488f` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:58.159139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775862d0-ab16-4706-b31b-6554afd63790 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=21915d6d53c54080a8c4d15c72508181, role_id=6ca03befbf3a456eae350bc7e583488f)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:58.160597 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775862d0-ab16-4706-b31b-6554afd63790 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:58.161291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:58.174571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 21/41] 10.222.0.47 () {58 vars in 1361 bytes} [Mon Jul 25 22:46:57 2022] PUT /identity/v3/domains/default/users/21915d6d53c54080a8c4d15c72508181/roles/6ca03befbf3a456eae350bc7e583488f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:46:58.175885 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b5e36-6558-43ff-91a6-25166c7df75c None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:58.176183 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b5e36-6558-43ff-91a6-25166c7df75c None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:58.176469 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b5e36-6558-43ff-91a6-25166c7df75c None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:58.177911 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 22/42] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:58.183503 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ece54-1607-4b92-8bf0-a88b23e1954c None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:58.183814 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ece54-1607-4b92-8bf0-a88b23e1954c None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:58.184076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ece54-1607-4b92-8bf0-a88b23e1954c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:58.194818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b21d4-3db9-4ac9-96a6-7284e9edab0b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=fJxK3QYXRJ6GeXFHB6UFcg, audit_chain_id=['fJxK3QYXRJ6GeXFHB6UFcg']) at 0x7f8a0fe850d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:58.195472 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b21d4-3db9-4ac9-96a6-7284e9edab0b None admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:58.195766 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b21d4-3db9-4ac9-96a6-7284e9edab0b None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:58.196051 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b21d4-3db9-4ac9-96a6-7284e9edab0b None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:58.196798 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b21d4-3db9-4ac9-96a6-7284e9edab0b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:58.198302 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b21d4-3db9-4ac9-96a6-7284e9edab0b None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:58.198447 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:58.205634 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-114ece54-1607-4b92-8bf0-a88b23e1954c None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:58.207772 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-114ece54-1607-4b92-8bf0-a88b23e1954c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:58.214475 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 21/43] 10.222.0.47 () {60 vars in 1131 bytes} [Mon Jul 25 22:46:58 2022] POST /identity/v3/roles => generated 223 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:46:58.297494 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 23/44] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:46:58.322953 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b21d4-3db9-4ac9-96a6-7284e9edab0b None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:58.440401 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b21d4-3db9-4ac9-96a6-7284e9edab0b None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:58.478593 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6ddb9-3f3c-400c-887b-14d8fc43a64c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=crtk49wLQuyALAZ6O8VoHg, audit_chain_id=['crtk49wLQuyALAZ6O8VoHg']) at 0x7f8a0fe13ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:58.479249 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6ddb9-3f3c-400c-887b-14d8fc43a64c None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:58.479591 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6ddb9-3f3c-400c-887b-14d8fc43a64c None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:58.479871 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6ddb9-3f3c-400c-887b-14d8fc43a64c None admin] PATH_INFO: `/v3/domains/default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:58.481043 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6ddb9-3f3c-400c-887b-14d8fc43a64c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:58.482545 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6ddb9-3f3c-400c-887b-14d8fc43a64c None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:58.484136 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 22/45] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:46:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:46:58.490297 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ece54-1607-4b92-8bf0-a88b23e1954c None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:58.588574 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ece54-1607-4b92-8bf0-a88b23e1954c None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:58.623505 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73d970-2cb8-4b59-9d38-31879ee8fd83 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=crtk49wLQuyALAZ6O8VoHg, audit_chain_id=['crtk49wLQuyALAZ6O8VoHg']) at 0x7f8a142132b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:58.624050 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73d970-2cb8-4b59-9d38-31879ee8fd83 None admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:58.624333 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73d970-2cb8-4b59-9d38-31879ee8fd83 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:58.624609 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73d970-2cb8-4b59-9d38-31879ee8fd83 None admin] PATH_INFO: `/v3/projects` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:58.626078 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73d970-2cb8-4b59-9d38-31879ee8fd83 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:58.627526 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73d970-2cb8-4b59-9d38-31879ee8fd83 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:58.632938 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:58.653735 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Jul 25 22:46:58 2022] POST /identity/v3/projects => generated 312 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:47:00.424941 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603fe0b-1343-4354-9e85-9ab0ed445f69 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:00.425463 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603fe0b-1343-4354-9e85-9ab0ed445f69 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:00.425545 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603fe0b-1343-4354-9e85-9ab0ed445f69 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:00.426896 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 23/47] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:00.432405 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5a780-928d-4990-aade-936a563fbf69 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:00.432784 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5a780-928d-4990-aade-936a563fbf69 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:00.433085 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5a780-928d-4990-aade-936a563fbf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:00.451142 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-1fa5a780-928d-4990-aade-936a563fbf69 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:00.452322 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-1fa5a780-928d-4990-aade-936a563fbf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:00.522730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 25/48] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:47:00.547594 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603fe0b-1343-4354-9e85-9ab0ed445f69 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:00.582522 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:00.648992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603fe0b-1343-4354-9e85-9ab0ed445f69 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:00.683436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8002f-5618-463b-a8e5-639b9800d5fe None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=z3M9nZbkQdGmwk1-CGwCbA, audit_chain_id=['z3M9nZbkQdGmwk1-CGwCbA']) at 0x7f8a0fe20c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:00.684015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8002f-5618-463b-a8e5-639b9800d5fe None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:00.684306 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8002f-5618-463b-a8e5-639b9800d5fe None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:00.684590 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8002f-5618-463b-a8e5-639b9800d5fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:00.694739 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8002f-5618-463b-a8e5-639b9800d5fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:00.699733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-52f8002f-5618-463b-a8e5-639b9800d5fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:47:00.699733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:00.699733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:00.699733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:00.699733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:00.699733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:00.699733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:00.699733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:00.699733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:00.699733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:00.699733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:00.699733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:00.699733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:00.699733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:00.699733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:00.699733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:00.700593 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:00.700593 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:00.700593 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:00.700593 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:00.700593 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:00.700593 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:00.700593 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:00.700593 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:00.700593 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:00.700593 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:00.700593 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:00.700593 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:00.700593 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:00.700593 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:00.700593 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:00.700593 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:00.701345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:00.701345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:00.701345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:00.701345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:00.701345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:00.701345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:00.701345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:00.701345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:00.701345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:00.701345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:00.701345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:47:00.701345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:00.701345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 24/49] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 22:47:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:00.708477 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5a780-928d-4990-aade-936a563fbf69 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:00.811280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5a780-928d-4990-aade-936a563fbf69 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:00.828801 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:00.848096 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cfb2c-35e6-42f4-b907-113f31df4e89 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=z3M9nZbkQdGmwk1-CGwCbA, audit_chain_id=['z3M9nZbkQdGmwk1-CGwCbA']) at 0x7f8a14213790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:00.848754 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cfb2c-35e6-42f4-b907-113f31df4e89 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:00.849045 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cfb2c-35e6-42f4-b907-113f31df4e89 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:00.849328 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cfb2c-35e6-42f4-b907-113f31df4e89 None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:00.850099 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cfb2c-35e6-42f4-b907-113f31df4e89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:00.850412 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cfb2c-35e6-42f4-b907-113f31df4e89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:00.851803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cfb2c-35e6-42f4-b907-113f31df4e89 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:00.864177 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 26/50] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:00.869759 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8002f-5618-463b-a8e5-639b9800d5fe None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:00.886123 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d923c-5045-43de-a063-dbd376557ef1 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:00.886414 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d923c-5045-43de-a063-dbd376557ef1 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:00.886698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d923c-5045-43de-a063-dbd376557ef1 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:00.888022 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 27/51] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:47:00.893794 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b31975-b6d6-4d8d-a61a-a228a7b1a2fa None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:00.894087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b31975-b6d6-4d8d-a61a-a228a7b1a2fa None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:00.894374 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b31975-b6d6-4d8d-a61a-a228a7b1a2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:00.912151 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-a0b31975-b6d6-4d8d-a61a-a228a7b1a2fa None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:00.913331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-a0b31975-b6d6-4d8d-a61a-a228a7b1a2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:00.965182 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:00.972538 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8002f-5618-463b-a8e5-639b9800d5fe None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:00.985327 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 28/52] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:47:01.011101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b31975-b6d6-4d8d-a61a-a228a7b1a2fa None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:01.014764 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24feec6-d816-4ae5-909d-bee7751998b2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=z3M9nZbkQdGmwk1-CGwCbA, audit_chain_id=['z3M9nZbkQdGmwk1-CGwCbA']) at 0x7f8a0fe20190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:01.015504 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24feec6-d816-4ae5-909d-bee7751998b2 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:01.016348 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24feec6-d816-4ae5-909d-bee7751998b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:01.016632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24feec6-d816-4ae5-909d-bee7751998b2 None admin] PATH_INFO: `/v3/users/21915d6d53c54080a8c4d15c72508181` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:01.018105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24feec6-d816-4ae5-909d-bee7751998b2 None admin] RBAC: Authorizing `identity:get_user(user_id=21915d6d53c54080a8c4d15c72508181)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:01.019565 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24feec6-d816-4ae5-909d-bee7751998b2 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:01.021168 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 25/53] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:00 2022] GET /identity/v3/users/21915d6d53c54080a8c4d15c72508181 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:01.026503 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24feec6-d816-4ae5-909d-bee7751998b2 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:01.111927 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b31975-b6d6-4d8d-a61a-a228a7b1a2fa None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:01.122224 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:01.126936 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24feec6-d816-4ae5-909d-bee7751998b2 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:01.147081 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0c19b-6f7b-4550-b55a-b0c1a74dcc9b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Y7RA7Q63RKaeGZbo54r7ww, audit_chain_id=['Y7RA7Q63RKaeGZbo54r7ww']) at 0x7f8a14213fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:01.147726 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0c19b-6f7b-4550-b55a-b0c1a74dcc9b None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:01.148013 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0c19b-6f7b-4550-b55a-b0c1a74dcc9b None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:01.148297 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0c19b-6f7b-4550-b55a-b0c1a74dcc9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:01.149445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0c19b-6f7b-4550-b55a-b0c1a74dcc9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:01.150933 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0c19b-6f7b-4550-b55a-b0c1a74dcc9b None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:01.152506 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 29/54] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:47:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:01.158815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0c19b-6f7b-4550-b55a-b0c1a74dcc9b None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:01.162251 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec29fa-2dd2-4c1c-a021-50047113dba7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=z3M9nZbkQdGmwk1-CGwCbA, audit_chain_id=['z3M9nZbkQdGmwk1-CGwCbA']) at 0x7f8a0fe2ae20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:01.162906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec29fa-2dd2-4c1c-a021-50047113dba7 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:01.163193 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec29fa-2dd2-4c1c-a021-50047113dba7 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:01.163475 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec29fa-2dd2-4c1c-a021-50047113dba7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:01.164643 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec29fa-2dd2-4c1c-a021-50047113dba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:01.166142 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec29fa-2dd2-4c1c-a021-50047113dba7 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:01.167723 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 26/55] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:47:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:01.174044 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec29fa-2dd2-4c1c-a021-50047113dba7 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:01.204519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:01.260549 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0c19b-6f7b-4550-b55a-b0c1a74dcc9b None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:01.275379 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec29fa-2dd2-4c1c-a021-50047113dba7 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:01.296680 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4671a8-af91-47ca-ae6b-34dd002b53e2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Y7RA7Q63RKaeGZbo54r7ww, audit_chain_id=['Y7RA7Q63RKaeGZbo54r7ww']) at 0x7f8a1415fdc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:01.297292 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4671a8-af91-47ca-ae6b-34dd002b53e2 None admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:01.297599 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4671a8-af91-47ca-ae6b-34dd002b53e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:01.297880 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4671a8-af91-47ca-ae6b-34dd002b53e2 None admin] PATH_INFO: `/v3/projects` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:01.298556 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4671a8-af91-47ca-ae6b-34dd002b53e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:01.299983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4671a8-af91-47ca-ae6b-34dd002b53e2 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:01.309134 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d714771-a775-4366-b550-2dd9f0ee0df6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=z3M9nZbkQdGmwk1-CGwCbA, audit_chain_id=['z3M9nZbkQdGmwk1-CGwCbA']) at 0x7f8a0fe2a580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:01.309790 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d714771-a775-4366-b550-2dd9f0ee0df6 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:01.310083 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d714771-a775-4366-b550-2dd9f0ee0df6 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:01.310366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d714771-a775-4366-b550-2dd9f0ee0df6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:01.311159 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d714771-a775-4366-b550-2dd9f0ee0df6 None admin] RBAC: Adding query filter params (role.id=6ca03befbf3a456eae350bc7e583488f, scope.domain.id=default, user.id=21915d6d53c54080a8c4d15c72508181) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:01.311473 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d714771-a775-4366-b550-2dd9f0ee0df6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:01.313441 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d714771-a775-4366-b550-2dd9f0ee0df6 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:01.319641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 27/56] 10.222.0.47 () {56 vars in 1322 bytes} [Mon Jul 25 22:47:01 2022] GET /identity/v3/role_assignments?user.id=21915d6d53c54080a8c4d15c72508181&scope.domain.id=default&role.id=6ca03befbf3a456eae350bc7e583488f => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:01.326435 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 30/57] 10.222.0.47 () {60 vars in 1140 bytes} [Mon Jul 25 22:47:01 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:47:03.594358 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c314d4b-4a1a-483a-bb43-18f8bfac42e6 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:03.594893 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c314d4b-4a1a-483a-bb43-18f8bfac42e6 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:03.595021 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c314d4b-4a1a-483a-bb43-18f8bfac42e6 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:03.596375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 28/58] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:03.601555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1267d-c72e-420f-9ebd-317836840fe4 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:03.601999 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1267d-c72e-420f-9ebd-317836840fe4 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:03.602152 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1267d-c72e-420f-9ebd-317836840fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:03.620526 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-0ee1267d-c72e-420f-9ebd-317836840fe4 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:03.621773 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-0ee1267d-c72e-420f-9ebd-317836840fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:03.645170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:03.688988 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 31/59] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:03.714990 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c314d4b-4a1a-483a-bb43-18f8bfac42e6 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:03.807951 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:03.815406 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c314d4b-4a1a-483a-bb43-18f8bfac42e6 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:03.849323 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457efe9-6b3b-4647-b22b-f824fe182283 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xY7QNzFBQGCg7b7XqMq9Nw, audit_chain_id=['xY7QNzFBQGCg7b7XqMq9Nw']) at 0x7f8a0fe10a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:03.849998 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457efe9-6b3b-4647-b22b-f824fe182283 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:03.850289 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457efe9-6b3b-4647-b22b-f824fe182283 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:03.850574 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457efe9-6b3b-4647-b22b-f824fe182283 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:03.851734 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457efe9-6b3b-4647-b22b-f824fe182283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:03.853193 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457efe9-6b3b-4647-b22b-f824fe182283 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:03.854804 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 29/60] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:47:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:03.860859 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1267d-c72e-420f-9ebd-317836840fe4 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:03.957119 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1267d-c72e-420f-9ebd-317836840fe4 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:03.990952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb997d81-ea94-480d-89e6-983693f96561 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xY7QNzFBQGCg7b7XqMq9Nw, audit_chain_id=['xY7QNzFBQGCg7b7XqMq9Nw']) at 0x7f8a142889d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:03.991578 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb997d81-ea94-480d-89e6-983693f96561 None admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:03.991864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb997d81-ea94-480d-89e6-983693f96561 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:03.992144 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb997d81-ea94-480d-89e6-983693f96561 None admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:03.992844 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb997d81-ea94-480d-89e6-983693f96561 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:03.994333 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb997d81-ea94-480d-89e6-983693f96561 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:04.020891 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 32/61] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 22:47:03 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:47:07.409846 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950219fb-f81b-4830-ab09-08daa294b838 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:07.410873 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950219fb-f81b-4830-ab09-08daa294b838 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:07.411364 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950219fb-f81b-4830-ab09-08daa294b838 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:07.412925 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 30/62] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:07.418309 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af727a-b862-404f-b0dc-2c3444539913 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:07.419137 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af727a-b862-404f-b0dc-2c3444539913 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:07.419618 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af727a-b862-404f-b0dc-2c3444539913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:07.446979 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-26af727a-b862-404f-b0dc-2c3444539913 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:07.448522 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-26af727a-b862-404f-b0dc-2c3444539913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:07.467332 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:07.542077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 33/63] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:07.580207 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950219fb-f81b-4830-ab09-08daa294b838 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:07.676911 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321610c-3ab5-4a2d-a91d-714368b02d20 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:07.677213 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321610c-3ab5-4a2d-a91d-714368b02d20 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:07.677392 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321610c-3ab5-4a2d-a91d-714368b02d20 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:07.678835 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 34/64] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:47:07.687964 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b650844-7de8-4cde-bb13-d47040b2ef54 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:07.688775 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b650844-7de8-4cde-bb13-d47040b2ef54 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:07.689738 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b650844-7de8-4cde-bb13-d47040b2ef54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:07.706830 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950219fb-f81b-4830-ab09-08daa294b838 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:07.712883 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-0b650844-7de8-4cde-bb13-d47040b2ef54 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:07.714374 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-0b650844-7de8-4cde-bb13-d47040b2ef54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:07.771060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2223c6-5fea-454d-b3ea-44404c865ec2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WyS3qvQtR2WK11WEKjPuyw, audit_chain_id=['WyS3qvQtR2WK11WEKjPuyw']) at 0x7f8a0fe2a460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:07.776151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2223c6-5fea-454d-b3ea-44404c865ec2 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:07.776675 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2223c6-5fea-454d-b3ea-44404c865ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:07.777152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2223c6-5fea-454d-b3ea-44404c865ec2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:07.797261 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2223c6-5fea-454d-b3ea-44404c865ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:07.804345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-9c2223c6-5fea-454d-b3ea-44404c865ec2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:07.804345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:07.804345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:07.804345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:07.804345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:07.804345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:07.804345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:07.804345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:07.804345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:07.804345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:07.804345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:07.804345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:07.804345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:07.804345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:07.804345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:07.804345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:07.805184 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:07.805184 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:07.805184 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:07.805184 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:07.805184 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:07.805184 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:07.805184 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:07.805184 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:07.805184 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:07.805184 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:07.805184 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:07.805184 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:07.805184 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:07.805184 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:07.805184 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:07.805184 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:07.805976 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:07.805976 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:07.805976 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:07.805976 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:07.805976 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:07.805976 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:07.805976 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:07.805976 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:07.805976 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:07.805976 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:07.805976 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:07.805976 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:07.818676 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 31/65] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:07.824339 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2223c6-5fea-454d-b3ea-44404c865ec2 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:07.832960 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 35/66] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:07.834481 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1156654-5ac0-4001-8a25-b03529744bf1 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:07.834782 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1156654-5ac0-4001-8a25-b03529744bf1 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:07.835066 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1156654-5ac0-4001-8a25-b03529744bf1 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:07.836445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 36/67] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:07.841965 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9a763-a728-4eab-b116-3ff3a4094a79 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:07.842261 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9a763-a728-4eab-b116-3ff3a4094a79 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:07.842552 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9a763-a728-4eab-b116-3ff3a4094a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:07.854043 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:07.863206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-15b9a763-a728-4eab-b116-3ff3a4094a79 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:07.864762 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-15b9a763-a728-4eab-b116-3ff3a4094a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:07.948993 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 37/68] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:47:07.950222 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9a763-a728-4eab-b116-3ff3a4094a79 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:07.959492 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:07.961247 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2223c6-5fea-454d-b3ea-44404c865ec2 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:08.002834 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04461121-d9f0-4587-b65f-8cbfcdae8d80 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WyS3qvQtR2WK11WEKjPuyw, audit_chain_id=['WyS3qvQtR2WK11WEKjPuyw']) at 0x7f8a0fe3fb80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:08.003927 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04461121-d9f0-4587-b65f-8cbfcdae8d80 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:08.004417 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04461121-d9f0-4587-b65f-8cbfcdae8d80 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:08.004896 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04461121-d9f0-4587-b65f-8cbfcdae8d80 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:08.005960 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04461121-d9f0-4587-b65f-8cbfcdae8d80 None admin] RBAC: Adding query filter params (name=member) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:08.006604 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04461121-d9f0-4587-b65f-8cbfcdae8d80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:08.008378 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04461121-d9f0-4587-b65f-8cbfcdae8d80 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:08.020462 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 32/69] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:08.021820 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04461121-d9f0-4587-b65f-8cbfcdae8d80 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:08.079263 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9a763-a728-4eab-b116-3ff3a4094a79 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:08.113747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:08.120272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640d32b-48e1-425c-9184-24be04689b5f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wP1sWUpnQqKFV53_PbR5bg, audit_chain_id=['wP1sWUpnQqKFV53_PbR5bg']) at 0x7f8a14d54cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:08.120991 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640d32b-48e1-425c-9184-24be04689b5f None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:08.121288 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640d32b-48e1-425c-9184-24be04689b5f None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:08.121598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640d32b-48e1-425c-9184-24be04689b5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:08.131912 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04461121-d9f0-4587-b65f-8cbfcdae8d80 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:08.134209 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640d32b-48e1-425c-9184-24be04689b5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:08.141571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-d640d32b-48e1-425c-9184-24be04689b5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:47:08.141571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:08.141571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:08.141571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:08.141571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:08.141571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:08.141571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:08.141571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:08.141571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:08.141571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:08.141571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:08.141571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:08.141571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:08.141571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:08.141571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:08.141571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:08.142730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:08.142730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:08.142730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:08.142730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:08.142730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:08.142730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:08.142730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:08.142730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:08.142730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:08.142730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:08.142730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:08.142730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:08.142730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:08.142730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:08.142730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:08.142730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:08.143474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:08.143474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:08.143474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:08.143474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:08.143474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:08.143474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:08.143474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:08.143474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:08.143474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:08.143474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:08.143474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:47:08.143474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:47:08.143474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 38/70] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 22:47:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:08.144089 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640d32b-48e1-425c-9184-24be04689b5f None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:08.169089 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519751bd-a85d-40ee-9ba9-86f8592c37f0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QKB-v6fNRJGaw8XcLEQ1pw, audit_chain_id=['QKB-v6fNRJGaw8XcLEQ1pw']) at 0x7f8a0fe227f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:08.169850 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519751bd-a85d-40ee-9ba9-86f8592c37f0 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:08.170136 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519751bd-a85d-40ee-9ba9-86f8592c37f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:08.170445 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519751bd-a85d-40ee-9ba9-86f8592c37f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:08.180669 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519751bd-a85d-40ee-9ba9-86f8592c37f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:08.185741 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-519751bd-a85d-40ee-9ba9-86f8592c37f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:08.185741 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:08.185741 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:08.185741 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:08.185741 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:08.185741 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:08.185741 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:08.185741 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:08.185741 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:08.185741 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:08.185741 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:08.185741 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:08.185741 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:08.185741 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:08.185741 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:08.185741 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:08.186657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:08.186657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:08.186657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:08.186657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:08.186657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:08.186657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:08.186657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:08.186657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:08.186657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:08.186657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:08.186657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:08.186657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:08.186657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:08.186657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:08.186657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:08.186657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:08.188375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:08.188375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:08.188375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:08.188375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:08.188375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:08.188375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:08.188375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:08.188375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:08.188375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:08.188375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:08.188375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:08.188375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:08.188375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 33/71] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:47:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:08.189324 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb01ed-bba6-436c-8e5b-9aa8aad025f8 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:08.189324 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb01ed-bba6-436c-8e5b-9aa8aad025f8 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:08.189448 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb01ed-bba6-436c-8e5b-9aa8aad025f8 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:08.190637 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 34/72] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:08.191664 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac374ad3-a3bb-4b7f-b8d7-3f7ca5c77707 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:08.192015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac374ad3-a3bb-4b7f-b8d7-3f7ca5c77707 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:08.192303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac374ad3-a3bb-4b7f-b8d7-3f7ca5c77707 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:08.193478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 35/73] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:08.194329 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac374ad3-a3bb-4b7f-b8d7-3f7ca5c77707 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:08.230004 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:08.267081 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640d32b-48e1-425c-9184-24be04689b5f None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:08.300992 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de36192-2c12-4129-912d-de90ac623af2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WyS3qvQtR2WK11WEKjPuyw, audit_chain_id=['WyS3qvQtR2WK11WEKjPuyw']) at 0x7f8a14202250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:08.301670 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de36192-2c12-4129-912d-de90ac623af2 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:08.301958 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de36192-2c12-4129-912d-de90ac623af2 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:08.302238 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de36192-2c12-4129-912d-de90ac623af2 None admin] PATH_INFO: `/v3/users/e088deb3ffe740c48565d7c35c2e9bc9` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:08.303312 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac374ad3-a3bb-4b7f-b8d7-3f7ca5c77707 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:08.317727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de36192-2c12-4129-912d-de90ac623af2 None admin] RBAC: Authorizing `identity:get_user(user_id=e088deb3ffe740c48565d7c35c2e9bc9)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:08.319214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de36192-2c12-4129-912d-de90ac623af2 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:08.320864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 39/74] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:08 2022] GET /identity/v3/users/e088deb3ffe740c48565d7c35c2e9bc9 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:08.321751 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de36192-2c12-4129-912d-de90ac623af2 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:08.340931 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203e1ee-aa9d-4155-962c-410817ce4ef9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wP1sWUpnQqKFV53_PbR5bg, audit_chain_id=['wP1sWUpnQqKFV53_PbR5bg']) at 0x7f8a0fe101c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:08.341607 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203e1ee-aa9d-4155-962c-410817ce4ef9 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:08.341905 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203e1ee-aa9d-4155-962c-410817ce4ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:08.342185 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203e1ee-aa9d-4155-962c-410817ce4ef9 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:08.342904 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203e1ee-aa9d-4155-962c-410817ce4ef9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:08.343279 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203e1ee-aa9d-4155-962c-410817ce4ef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:08.344698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203e1ee-aa9d-4155-962c-410817ce4ef9 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:08.352705 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 36/75] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:08.353877 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ff20d-997f-48d2-8102-55ccf7070c12 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:08.354166 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ff20d-997f-48d2-8102-55ccf7070c12 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:08.354445 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ff20d-997f-48d2-8102-55ccf7070c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:08.367150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:08.372985 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-9b7ff20d-997f-48d2-8102-55ccf7070c12 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:08.374337 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-9b7ff20d-997f-48d2-8102-55ccf7070c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:08.426211 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de36192-2c12-4129-912d-de90ac623af2 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:08.443330 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 37/76] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:08.447289 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f64b5-d57f-49ed-9a92-9ec178846de8 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:08.447594 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f64b5-d57f-49ed-9a92-9ec178846de8 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:08.447879 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f64b5-d57f-49ed-9a92-9ec178846de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:08.450421 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:08.467912 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-1b5f64b5-d57f-49ed-9a92-9ec178846de8 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:08.468147 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6397855-450a-49b0-a28f-0653b52d105a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QKB-v6fNRJGaw8XcLEQ1pw, audit_chain_id=['QKB-v6fNRJGaw8XcLEQ1pw']) at 0x7f8a0fee1520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:08.468646 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6397855-450a-49b0-a28f-0653b52d105a None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:08.468931 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6397855-450a-49b0-a28f-0653b52d105a None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:08.469208 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6397855-450a-49b0-a28f-0653b52d105a None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:08.469843 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-1b5f64b5-d57f-49ed-9a92-9ec178846de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:08.469994 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6397855-450a-49b0-a28f-0653b52d105a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:08.470305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6397855-450a-49b0-a28f-0653b52d105a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:08.471693 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6397855-450a-49b0-a28f-0653b52d105a None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:08.482685 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 40/77] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:47:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:08.483289 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6397855-450a-49b0-a28f-0653b52d105a None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:08.539577 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 38/78] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:08.540652 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f64b5-d57f-49ed-9a92-9ec178846de8 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:08.587607 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6397855-450a-49b0-a28f-0653b52d105a None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:08.607456 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:08.622940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4817ac7-7c56-4dd4-958a-f2dd086a547a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WyS3qvQtR2WK11WEKjPuyw, audit_chain_id=['WyS3qvQtR2WK11WEKjPuyw']) at 0x7f8a0fea1790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:08.623561 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4817ac7-7c56-4dd4-958a-f2dd086a547a None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:08.623841 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4817ac7-7c56-4dd4-958a-f2dd086a547a None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:08.624121 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4817ac7-7c56-4dd4-958a-f2dd086a547a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:08.643977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f64b5-d57f-49ed-9a92-9ec178846de8 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:08.680010 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c1271-e9a4-4b8c-924e-79d3ce29f54f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wP1sWUpnQqKFV53_PbR5bg, audit_chain_id=['wP1sWUpnQqKFV53_PbR5bg']) at 0x7f8a0fe0cfd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:08.680664 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c1271-e9a4-4b8c-924e-79d3ce29f54f None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:08.680954 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c1271-e9a4-4b8c-924e-79d3ce29f54f None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:08.681265 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c1271-e9a4-4b8c-924e-79d3ce29f54f None admin] PATH_INFO: `/v3/users/21915d6d53c54080a8c4d15c72508181` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:08.682492 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c1271-e9a4-4b8c-924e-79d3ce29f54f None admin] RBAC: Authorizing `identity:get_user(user_id=21915d6d53c54080a8c4d15c72508181)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:08.683969 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c1271-e9a4-4b8c-924e-79d3ce29f54f None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:08.684675 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:08.685602 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 39/79] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:08 2022] GET /identity/v3/users/21915d6d53c54080a8c4d15c72508181 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:08.686386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c1271-e9a4-4b8c-924e-79d3ce29f54f None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:08.699927 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4817ac7-7c56-4dd4-958a-f2dd086a547a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:08.701414 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4817ac7-7c56-4dd4-958a-f2dd086a547a None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:08.788406 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c1271-e9a4-4b8c-924e-79d3ce29f54f None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:08.800032 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 41/80] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:08.800706 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4817ac7-7c56-4dd4-958a-f2dd086a547a None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:08.823860 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42a396-b753-4c8e-a242-b419ebe6a6ee None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5usp53aiSLK-IWzDrCHjsw, audit_chain_id=['5usp53aiSLK-IWzDrCHjsw']) at 0x7f8a0fe083d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:08.824506 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42a396-b753-4c8e-a242-b419ebe6a6ee None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:08.824792 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42a396-b753-4c8e-a242-b419ebe6a6ee None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:08.825064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42a396-b753-4c8e-a242-b419ebe6a6ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:08.826245 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42a396-b753-4c8e-a242-b419ebe6a6ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:08.828434 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42a396-b753-4c8e-a242-b419ebe6a6ee None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:08.830181 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 40/81] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:47:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:08.830794 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42a396-b753-4c8e-a242-b419ebe6a6ee None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:08.833264 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:08.889178 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:08.905513 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4817ac7-7c56-4dd4-958a-f2dd086a547a None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:08.929408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42a396-b753-4c8e-a242-b419ebe6a6ee None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:08.938855 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5bda3-a4e3-4624-af2d-6b243f060799 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QKB-v6fNRJGaw8XcLEQ1pw, audit_chain_id=['QKB-v6fNRJGaw8XcLEQ1pw']) at 0x7f8a0fe712e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:08.939501 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5bda3-a4e3-4624-af2d-6b243f060799 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:08.939786 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5bda3-a4e3-4624-af2d-6b243f060799 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:08.940063 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5bda3-a4e3-4624-af2d-6b243f060799 None admin] PATH_INFO: `/v3/users/e088deb3ffe740c48565d7c35c2e9bc9` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:08.941254 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5bda3-a4e3-4624-af2d-6b243f060799 None admin] RBAC: Authorizing `identity:get_user(user_id=e088deb3ffe740c48565d7c35c2e9bc9)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:08.942933 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5bda3-a4e3-4624-af2d-6b243f060799 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:08.944527 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 42/82] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:08 2022] GET /identity/v3/users/e088deb3ffe740c48565d7c35c2e9bc9 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:08.945299 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5bda3-a4e3-4624-af2d-6b243f060799 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:08.968070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2779e-c81c-44ce-9753-0c2de764f99e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=aEUVP1rBQJqjC-62DDXEeg, audit_chain_id=['aEUVP1rBQJqjC-62DDXEeg']) at 0x7f8a0fe08220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:08.968923 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2779e-c81c-44ce-9753-0c2de764f99e None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:08.969209 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2779e-c81c-44ce-9753-0c2de764f99e None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:08.969487 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2779e-c81c-44ce-9753-0c2de764f99e None admin] PATH_INFO: `/v3/roles/member` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:08.979635 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2779e-c81c-44ce-9753-0c2de764f99e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:08.985195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-61b2779e-c81c-44ce-9753-0c2de764f99e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:08.985195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:08.985195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:08.985195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:08.985195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:08.985195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:08.985195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:08.985195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:08.985195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:08.985195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:08.985195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:08.985195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:08.985195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:08.985195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:08.985195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:08.985195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:08.986130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:08.986130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:08.986130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:08.986130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:08.986130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:08.986130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:08.986130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:08.986130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:08.986130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:08.986130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:08.986130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:08.986130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:08.986130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:08.986130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:08.986130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:08.986130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:08.991906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:08.991906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:08.991906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:08.991906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:08.991906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:08.991906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:08.991906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:08.991906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:08.991906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:08.991906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:08.991906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:08.991906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:08.991906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 41/83] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:08.991906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2779e-c81c-44ce-9753-0c2de764f99e None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:09.048747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:09.054970 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5bda3-a4e3-4624-af2d-6b243f060799 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:09.088305 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2779e-c81c-44ce-9753-0c2de764f99e None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:09.089513 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc221c2-261a-4f5b-a67c-a85b3226744a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wP1sWUpnQqKFV53_PbR5bg, audit_chain_id=['wP1sWUpnQqKFV53_PbR5bg']) at 0x7f8a0fea41f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:09.090161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc221c2-261a-4f5b-a67c-a85b3226744a None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:09.090443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc221c2-261a-4f5b-a67c-a85b3226744a None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:09.090724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc221c2-261a-4f5b-a67c-a85b3226744a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:09.115099 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:09.122391 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2a042-ebf1-4f4a-acf6-ec9e60a83350 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WyS3qvQtR2WK11WEKjPuyw, audit_chain_id=['WyS3qvQtR2WK11WEKjPuyw']) at 0x7f8a0fe226a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:09.123098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2a042-ebf1-4f4a-acf6-ec9e60a83350 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:09.123412 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2a042-ebf1-4f4a-acf6-ec9e60a83350 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:09.123694 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2a042-ebf1-4f4a-acf6-ec9e60a83350 None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:09.125482 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2a042-ebf1-4f4a-acf6-ec9e60a83350 None admin] RBAC: Authorizing `identity:get_project(project_id=c312d273f41543edafc129654a960b7b)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:09.126974 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2a042-ebf1-4f4a-acf6-ec9e60a83350 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:09.128636 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 42/84] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:08 2022] GET /identity/v3/projects/c312d273f41543edafc129654a960b7b => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:09.129385 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2a042-ebf1-4f4a-acf6-ec9e60a83350 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:09.160978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc221c2-261a-4f5b-a67c-a85b3226744a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:09.162500 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc221c2-261a-4f5b-a67c-a85b3226744a None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:09.229531 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2a042-ebf1-4f4a-acf6-ec9e60a83350 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:09.259083 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:09.262981 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 43/85] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:09.263629 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc221c2-261a-4f5b-a67c-a85b3226744a None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:09.265532 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a489c02-f02c-4cda-82e7-7ec2129fd489 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5usp53aiSLK-IWzDrCHjsw, audit_chain_id=['5usp53aiSLK-IWzDrCHjsw']) at 0x7f8a0fe42ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:09.266205 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a489c02-f02c-4cda-82e7-7ec2129fd489 None admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:09.266492 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a489c02-f02c-4cda-82e7-7ec2129fd489 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:09.266773 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a489c02-f02c-4cda-82e7-7ec2129fd489 None admin] PATH_INFO: `/v3/users` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:09.267733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a489c02-f02c-4cda-82e7-7ec2129fd489 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:09.269195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a489c02-f02c-4cda-82e7-7ec2129fd489 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:09.295619 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 43/86] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 22:47:09 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:47:09.298577 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a489c02-f02c-4cda-82e7-7ec2129fd489 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:09.329248 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:09.380909 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc221c2-261a-4f5b-a67c-a85b3226744a None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:09.418351 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a489c02-f02c-4cda-82e7-7ec2129fd489 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:09.420201 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc79731-436e-4716-a212-ee539b8709e6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QKB-v6fNRJGaw8XcLEQ1pw, audit_chain_id=['QKB-v6fNRJGaw8XcLEQ1pw']) at 0x7f8a0fe94670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:09.420840 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc79731-436e-4716-a212-ee539b8709e6 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:09.421776 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc79731-436e-4716-a212-ee539b8709e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:09.422086 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc79731-436e-4716-a212-ee539b8709e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:09.465739 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fc951-2c20-4b50-88bb-8a8a867fe3b7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=aEUVP1rBQJqjC-62DDXEeg, audit_chain_id=['aEUVP1rBQJqjC-62DDXEeg']) at 0x7f8a0fe206a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:09.466385 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fc951-2c20-4b50-88bb-8a8a867fe3b7 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:09.466664 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fc951-2c20-4b50-88bb-8a8a867fe3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:09.466941 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fc951-2c20-4b50-88bb-8a8a867fe3b7 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:09.467674 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fc951-2c20-4b50-88bb-8a8a867fe3b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:09.468552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fc951-2c20-4b50-88bb-8a8a867fe3b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:09.470029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1fc951-2c20-4b50-88bb-8a8a867fe3b7 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:09.480157 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 44/87] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:09.481194 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fc951-2c20-4b50-88bb-8a8a867fe3b7 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:09.505309 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc79731-436e-4716-a212-ee539b8709e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:09.506862 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc79731-436e-4716-a212-ee539b8709e6 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:09.542618 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:09.582343 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:09.614073 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fc951-2c20-4b50-88bb-8a8a867fe3b7 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:09.644643 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 44/88] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:09.645613 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc79731-436e-4716-a212-ee539b8709e6 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:09.667768 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd0cb7-b7ba-4516-accd-6fdbe96924e0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WyS3qvQtR2WK11WEKjPuyw, audit_chain_id=['WyS3qvQtR2WK11WEKjPuyw']) at 0x7f8a0fe70760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:09.668743 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd0cb7-b7ba-4516-accd-6fdbe96924e0 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:09.669037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd0cb7-b7ba-4516-accd-6fdbe96924e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:09.669314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd0cb7-b7ba-4516-accd-6fdbe96924e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:09.670157 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd0cb7-b7ba-4516-accd-6fdbe96924e0 None admin] RBAC: Adding query filter params (role.id=c57f45d724fe45009701c9b2706d661c, scope.project.id=c312d273f41543edafc129654a960b7b, user.id=e088deb3ffe740c48565d7c35c2e9bc9) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:09.670469 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd0cb7-b7ba-4516-accd-6fdbe96924e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:09.673161 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bd0cb7-b7ba-4516-accd-6fdbe96924e0 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:09.681587 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 45/89] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:47:09 2022] GET /identity/v3/role_assignments?user.id=e088deb3ffe740c48565d7c35c2e9bc9&scope.project.id=c312d273f41543edafc129654a960b7b&role.id=c57f45d724fe45009701c9b2706d661c => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:09.682817 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd0cb7-b7ba-4516-accd-6fdbe96924e0 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:09.758863 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc79731-436e-4716-a212-ee539b8709e6 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:09.797442 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edbdff-a589-416f-8047-6ec211c1434e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wP1sWUpnQqKFV53_PbR5bg, audit_chain_id=['wP1sWUpnQqKFV53_PbR5bg']) at 0x7f8a0fe947c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:09.798166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edbdff-a589-416f-8047-6ec211c1434e None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:09.798460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edbdff-a589-416f-8047-6ec211c1434e None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:09.798748 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edbdff-a589-416f-8047-6ec211c1434e None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:09.799963 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4edbdff-a589-416f-8047-6ec211c1434e None admin] RBAC: Authorizing `identity:get_project(project_id=c312d273f41543edafc129654a960b7b)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:09.801757 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4edbdff-a589-416f-8047-6ec211c1434e None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:09.804987 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 45/90] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:09 2022] GET /identity/v3/projects/c312d273f41543edafc129654a960b7b => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:09.805251 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd0cb7-b7ba-4516-accd-6fdbe96924e0 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:09.809458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edbdff-a589-416f-8047-6ec211c1434e None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:09.819780 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:09.842487 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:09.846377 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b86ec-2f12-4678-9a4b-beaa5a66ff5e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=aEUVP1rBQJqjC-62DDXEeg, audit_chain_id=['aEUVP1rBQJqjC-62DDXEeg']) at 0x7f8a0fe254f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:09.847244 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b86ec-2f12-4678-9a4b-beaa5a66ff5e None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:09.847667 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b86ec-2f12-4678-9a4b-beaa5a66ff5e None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:09.848208 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b86ec-2f12-4678-9a4b-beaa5a66ff5e None admin] PATH_INFO: `/v3/users/e088deb3ffe740c48565d7c35c2e9bc9` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:09.849659 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b86ec-2f12-4678-9a4b-beaa5a66ff5e None admin] RBAC: Authorizing `identity:get_user(user_id=e088deb3ffe740c48565d7c35c2e9bc9)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:09.851369 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b86ec-2f12-4678-9a4b-beaa5a66ff5e None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:09.853331 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 46/91] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:09 2022] GET /identity/v3/users/e088deb3ffe740c48565d7c35c2e9bc9 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:09.854105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b86ec-2f12-4678-9a4b-beaa5a66ff5e None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:09.924724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edbdff-a589-416f-8047-6ec211c1434e None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:09.963462 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e85899-82ab-4bd2-a9a1-3385e2079ea2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QKB-v6fNRJGaw8XcLEQ1pw, audit_chain_id=['QKB-v6fNRJGaw8XcLEQ1pw']) at 0x7f8a0fe962b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:09.964135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e85899-82ab-4bd2-a9a1-3385e2079ea2 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:09.964429 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e85899-82ab-4bd2-a9a1-3385e2079ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:09.964783 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e85899-82ab-4bd2-a9a1-3385e2079ea2 None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:09.965299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b86ec-2f12-4678-9a4b-beaa5a66ff5e None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:09.966078 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e85899-82ab-4bd2-a9a1-3385e2079ea2 None admin] RBAC: Authorizing `identity:get_project(project_id=c312d273f41543edafc129654a960b7b)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:09.967592 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e85899-82ab-4bd2-a9a1-3385e2079ea2 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:09.969464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 46/92] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:09 2022] GET /identity/v3/projects/c312d273f41543edafc129654a960b7b => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:09.970505 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e85899-82ab-4bd2-a9a1-3385e2079ea2 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:10.008921 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461600d-4579-4b65-b29a-e8714ab01594 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wP1sWUpnQqKFV53_PbR5bg, audit_chain_id=['wP1sWUpnQqKFV53_PbR5bg']) at 0x7f8a0fe206a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:10.009768 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461600d-4579-4b65-b29a-e8714ab01594 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:10.010131 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461600d-4579-4b65-b29a-e8714ab01594 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:10.010479 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461600d-4579-4b65-b29a-e8714ab01594 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:10.011342 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461600d-4579-4b65-b29a-e8714ab01594 None admin] RBAC: Adding query filter params (role.id=6ca03befbf3a456eae350bc7e583488f, scope.project.id=c312d273f41543edafc129654a960b7b, user.id=21915d6d53c54080a8c4d15c72508181) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:10.011721 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461600d-4579-4b65-b29a-e8714ab01594 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:10.013252 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461600d-4579-4b65-b29a-e8714ab01594 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:10.020627 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 47/93] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:47:09 2022] GET /identity/v3/role_assignments?user.id=21915d6d53c54080a8c4d15c72508181&scope.project.id=c312d273f41543edafc129654a960b7b&role.id=6ca03befbf3a456eae350bc7e583488f => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:10.021375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461600d-4579-4b65-b29a-e8714ab01594 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:10.073556 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:10.080698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:10.091494 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e85899-82ab-4bd2-a9a1-3385e2079ea2 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:10.132411 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b625a2-33a5-4f96-91f5-3cc14724cc29 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=aEUVP1rBQJqjC-62DDXEeg, audit_chain_id=['aEUVP1rBQJqjC-62DDXEeg']) at 0x7f8a0fe977f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:10.132973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b625a2-33a5-4f96-91f5-3cc14724cc29 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:10.133263 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b625a2-33a5-4f96-91f5-3cc14724cc29 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:10.133549 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b625a2-33a5-4f96-91f5-3cc14724cc29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:10.136417 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461600d-4579-4b65-b29a-e8714ab01594 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:10.177930 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3dc3a-50be-4630-a8d9-9fcee7344989 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QKB-v6fNRJGaw8XcLEQ1pw, audit_chain_id=['QKB-v6fNRJGaw8XcLEQ1pw']) at 0x7f8a0fe131f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:10.178570 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3dc3a-50be-4630-a8d9-9fcee7344989 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:10.178861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3dc3a-50be-4630-a8d9-9fcee7344989 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:10.179727 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3dc3a-50be-4630-a8d9-9fcee7344989 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:10.180638 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3dc3a-50be-4630-a8d9-9fcee7344989 None admin] RBAC: Adding query filter params (role.id=e0342a5e42664f35948f522071411514, scope.project.id=c312d273f41543edafc129654a960b7b, user.id=e088deb3ffe740c48565d7c35c2e9bc9) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:10.181044 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3dc3a-50be-4630-a8d9-9fcee7344989 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:10.182793 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3dc3a-50be-4630-a8d9-9fcee7344989 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:10.194788 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 48/94] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:47:10 2022] GET /identity/v3/role_assignments?user.id=e088deb3ffe740c48565d7c35c2e9bc9&scope.project.id=c312d273f41543edafc129654a960b7b&role.id=e0342a5e42664f35948f522071411514 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:10.232154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b625a2-33a5-4f96-91f5-3cc14724cc29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:10.233779 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b625a2-33a5-4f96-91f5-3cc14724cc29 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:10.350297 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:10.364671 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 47/95] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:10.373994 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3dc3a-50be-4630-a8d9-9fcee7344989 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:10.543212 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3dc3a-50be-4630-a8d9-9fcee7344989 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:10.559870 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:10.590750 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0a583-fee4-4ab5-bff5-1d8aa5fae963 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=aEUVP1rBQJqjC-62DDXEeg, audit_chain_id=['aEUVP1rBQJqjC-62DDXEeg']) at 0x7f8a14102760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:10.591581 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0a583-fee4-4ab5-bff5-1d8aa5fae963 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:10.591868 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0a583-fee4-4ab5-bff5-1d8aa5fae963 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:10.592147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0a583-fee4-4ab5-bff5-1d8aa5fae963 None admin] PATH_INFO: `/v3/projects/89b71af52ea14593953aa38fdefe4fa1` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:10.594318 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0a583-fee4-4ab5-bff5-1d8aa5fae963 None admin] RBAC: Authorizing `identity:get_project(project_id=89b71af52ea14593953aa38fdefe4fa1)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:10.596111 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0a583-fee4-4ab5-bff5-1d8aa5fae963 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:10.598044 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 49/96] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:10 2022] GET /identity/v3/projects/89b71af52ea14593953aa38fdefe4fa1 => generated 312 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:10.604242 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b625a2-33a5-4f96-91f5-3cc14724cc29 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:10.728486 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b625a2-33a5-4f96-91f5-3cc14724cc29 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:10.772764 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afccf62-d391-44b3-ba30-391418065d46 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=aEUVP1rBQJqjC-62DDXEeg, audit_chain_id=['aEUVP1rBQJqjC-62DDXEeg']) at 0x7f8a14202580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:10.773456 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afccf62-d391-44b3-ba30-391418065d46 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:10.773773 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afccf62-d391-44b3-ba30-391418065d46 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:10.774052 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afccf62-d391-44b3-ba30-391418065d46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:10.774849 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afccf62-d391-44b3-ba30-391418065d46 None admin] RBAC: Adding query filter params (role.id=c57f45d724fe45009701c9b2706d661c, scope.project.id=89b71af52ea14593953aa38fdefe4fa1, user.id=e088deb3ffe740c48565d7c35c2e9bc9) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:10.775162 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afccf62-d391-44b3-ba30-391418065d46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:10.776699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afccf62-d391-44b3-ba30-391418065d46 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:10.786862 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 48/97] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:47:10 2022] GET /identity/v3/role_assignments?user.id=e088deb3ffe740c48565d7c35c2e9bc9&scope.project.id=89b71af52ea14593953aa38fdefe4fa1&role.id=c57f45d724fe45009701c9b2706d661c => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:12.585174 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eb2fc-3b5c-4600-a682-eb27eca72341 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:12.586241 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eb2fc-3b5c-4600-a682-eb27eca72341 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:12.586742 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112eb2fc-3b5c-4600-a682-eb27eca72341 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:12.588327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 50/98] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:12.594319 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb0847-cf78-42dc-88b0-8896e1a398ce None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:12.595187 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb0847-cf78-42dc-88b0-8896e1a398ce None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:12.595673 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb0847-cf78-42dc-88b0-8896e1a398ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:12.618568 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-acdb0847-cf78-42dc-88b0-8896e1a398ce None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:12.620093 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-acdb0847-cf78-42dc-88b0-8896e1a398ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:12.688648 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:12.708263 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 49/99] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:12.717495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516d747-989b-4cc7-af98-86bb1770c8a4 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:12.718398 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516d747-989b-4cc7-af98-86bb1770c8a4 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:12.718952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f516d747-989b-4cc7-af98-86bb1770c8a4 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:12.720666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 51/100] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:12.726935 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4f6d1-7afc-4cac-8d3b-7f45f7efe20f None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:12.727559 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4f6d1-7afc-4cac-8d3b-7f45f7efe20f None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:12.728032 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4f6d1-7afc-4cac-8d3b-7f45f7efe20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:12.747865 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-8fc4f6d1-7afc-4cac-8d3b-7f45f7efe20f None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:12.749034 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516d747-989b-4cc7-af98-86bb1770c8a4 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:12.751819 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-8fc4f6d1-7afc-4cac-8d3b-7f45f7efe20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:12.824904 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 50/101] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:12.871152 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4f6d1-7afc-4cac-8d3b-7f45f7efe20f None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:12.899321 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f516d747-989b-4cc7-af98-86bb1770c8a4 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:12.953630 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed20047-cd83-41c6-93f5-caa724ccac17 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=E_kMBwUGQ3uUb73g1dChyQ, audit_chain_id=['E_kMBwUGQ3uUb73g1dChyQ']) at 0x7f8a0fe206d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:12.954289 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed20047-cd83-41c6-93f5-caa724ccac17 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:12.954578 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed20047-cd83-41c6-93f5-caa724ccac17 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:12.954862 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed20047-cd83-41c6-93f5-caa724ccac17 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:12.971911 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed20047-cd83-41c6-93f5-caa724ccac17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:12.980956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-9ed20047-cd83-41c6-93f5-caa724ccac17 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:47:12.980956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:12.980956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:12.980956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:12.980956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:12.980956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:12.980956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:12.980956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:12.980956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:12.980956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:12.980956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:12.980956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:12.980956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:12.980956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:12.980956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:12.980956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:12.981926 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:12.981926 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:12.981926 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:12.981926 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:12.981926 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:12.981926 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:12.981926 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:12.981926 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:12.981926 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:12.981926 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:12.981926 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:12.981926 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:12.981926 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:12.981926 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:12.981926 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:12.981926 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:12.982736 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:12.982736 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:12.982736 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:12.982736 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:12.982736 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:12.982736 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:12.982736 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:12.982736 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:12.982736 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:12.982736 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:12.982736 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:47:12.982736 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:12.985139 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 52/102] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:47:12.991597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed20047-cd83-41c6-93f5-caa724ccac17 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:12.994506 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4f6d1-7afc-4cac-8d3b-7f45f7efe20f None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:13.015126 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:13.034778 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d3f31-04c7-4bc7-ad2b-56d4f0476a68 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Dy38xnGASdCpKzoEAPq8Mg, audit_chain_id=['Dy38xnGASdCpKzoEAPq8Mg']) at 0x7f8a151699a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:13.035695 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d3f31-04c7-4bc7-ad2b-56d4f0476a68 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:13.036079 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d3f31-04c7-4bc7-ad2b-56d4f0476a68 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:13.036455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d3f31-04c7-4bc7-ad2b-56d4f0476a68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:13.037738 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d3f31-04c7-4bc7-ad2b-56d4f0476a68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:13.039357 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d3f31-04c7-4bc7-ad2b-56d4f0476a68 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:13.040952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 51/103] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:47:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:13.047708 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d3f31-04c7-4bc7-ad2b-56d4f0476a68 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:13.050024 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:13.123262 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed20047-cd83-41c6-93f5-caa724ccac17 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:13.155913 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d3f31-04c7-4bc7-ad2b-56d4f0476a68 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:13.167258 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed78776-7afa-441f-a439-e2af23f5d722 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=E_kMBwUGQ3uUb73g1dChyQ, audit_chain_id=['E_kMBwUGQ3uUb73g1dChyQ']) at 0x7f8a0fe22b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:13.168121 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed78776-7afa-441f-a439-e2af23f5d722 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:13.168563 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed78776-7afa-441f-a439-e2af23f5d722 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:13.169072 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed78776-7afa-441f-a439-e2af23f5d722 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:13.169980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed78776-7afa-441f-a439-e2af23f5d722 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:13.170431 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed78776-7afa-441f-a439-e2af23f5d722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:13.172840 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed78776-7afa-441f-a439-e2af23f5d722 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:13.189419 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 53/104] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:13.194812 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed78776-7afa-441f-a439-e2af23f5d722 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:13.195607 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6a611-a90b-441d-8e84-b05e6eb52761 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Dy38xnGASdCpKzoEAPq8Mg, audit_chain_id=['Dy38xnGASdCpKzoEAPq8Mg']) at 0x7f8a0fea1a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:13.196343 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6a611-a90b-441d-8e84-b05e6eb52761 None admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:13.196727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6a611-a90b-441d-8e84-b05e6eb52761 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:13.197105 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6a611-a90b-441d-8e84-b05e6eb52761 None admin] PATH_INFO: `/v3/projects` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:13.197947 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6a611-a90b-441d-8e84-b05e6eb52761 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:13.199532 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6a611-a90b-441d-8e84-b05e6eb52761 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:13.245807 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 52/105] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Jul 25 22:47:13 2022] POST /identity/v3/projects => generated 302 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:47:13.351626 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed78776-7afa-441f-a439-e2af23f5d722 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:13.360174 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:13.409012 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75804898-fa90-49ec-8a71-4ce708be52cc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=E_kMBwUGQ3uUb73g1dChyQ, audit_chain_id=['E_kMBwUGQ3uUb73g1dChyQ']) at 0x7f8a0fe20b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:13.410052 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804898-fa90-49ec-8a71-4ce708be52cc None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:13.410497 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804898-fa90-49ec-8a71-4ce708be52cc None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:13.410932 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75804898-fa90-49ec-8a71-4ce708be52cc None admin] PATH_INFO: `/v3/users/5874935317854b289ddc864c60faeac0` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:13.430479 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75804898-fa90-49ec-8a71-4ce708be52cc None admin] RBAC: Authorizing `identity:get_user(user_id=5874935317854b289ddc864c60faeac0)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:13.432258 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75804898-fa90-49ec-8a71-4ce708be52cc None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:13.434257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 54/106] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:13 2022] GET /identity/v3/users/5874935317854b289ddc864c60faeac0 => generated 289 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:13.442085 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6a611-a90b-441d-8e84-b05e6eb52761 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:13.503789 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:13.590300 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6a611-a90b-441d-8e84-b05e6eb52761 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:13.592461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ece2ed-d1e4-4e60-bb4d-f27eceb91ae2 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:13.593438 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ece2ed-d1e4-4e60-bb4d-f27eceb91ae2 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:13.593964 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ece2ed-d1e4-4e60-bb4d-f27eceb91ae2 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:13.595486 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 55/107] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:13.603445 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be061fba-02a6-404d-af32-7649efe6b6b8 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:13.603686 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be061fba-02a6-404d-af32-7649efe6b6b8 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:13.604220 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be061fba-02a6-404d-af32-7649efe6b6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:13.637185 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-be061fba-02a6-404d-af32-7649efe6b6b8 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:13.638931 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-be061fba-02a6-404d-af32-7649efe6b6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:13.643761 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f24663-2355-417b-99c6-15b05e2f5d26 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=E_kMBwUGQ3uUb73g1dChyQ, audit_chain_id=['E_kMBwUGQ3uUb73g1dChyQ']) at 0x7f8a0fe87e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:13.644403 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f24663-2355-417b-99c6-15b05e2f5d26 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:13.644689 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f24663-2355-417b-99c6-15b05e2f5d26 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:13.644970 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f24663-2355-417b-99c6-15b05e2f5d26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:13.775111 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 56/108] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:13.786538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f24663-2355-417b-99c6-15b05e2f5d26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:13.788068 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f24663-2355-417b-99c6-15b05e2f5d26 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:13.812675 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be061fba-02a6-404d-af32-7649efe6b6b8 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:13.839688 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:13.964991 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 53/109] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:13.965284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:13.974348 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138f2f1-0e01-4611-af26-1bff47770c60 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:13.974939 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138f2f1-0e01-4611-af26-1bff47770c60 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:13.975448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138f2f1-0e01-4611-af26-1bff47770c60 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:13.977288 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 54/110] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:13 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:13.978310 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138f2f1-0e01-4611-af26-1bff47770c60 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:13.986083 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be061fba-02a6-404d-af32-7649efe6b6b8 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:14.044923 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17532616-87df-4fb8-86a2-255473d73448 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Bcv2IzKMSAGDHuddzJ_H3w, audit_chain_id=['Bcv2IzKMSAGDHuddzJ_H3w']) at 0x7f8a0fe20e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:14.045604 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17532616-87df-4fb8-86a2-255473d73448 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:14.046724 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17532616-87df-4fb8-86a2-255473d73448 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:14.047037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17532616-87df-4fb8-86a2-255473d73448 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:14.071987 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17532616-87df-4fb8-86a2-255473d73448 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:14.077639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-17532616-87df-4fb8-86a2-255473d73448 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:14.077639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:14.077639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:14.077639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:14.077639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:14.077639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:14.077639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:14.077639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:14.077639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:14.077639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:14.077639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:14.077639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:14.077639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:14.077639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:14.077639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:14.077639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:14.078773 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:14.078773 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:14.078773 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:14.078773 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:14.078773 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:14.078773 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:14.078773 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:14.078773 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:14.078773 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:14.078773 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:14.078773 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:14.078773 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:14.078773 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:14.078773 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:14.078773 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:14.078773 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:14.085386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:14.085386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:14.085386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:14.085386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:14.085386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:14.085386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:14.085386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:14.085386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:14.085386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:14.085386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:14.085386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:14.085386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:14.085386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 57/111] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:47:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:47:14.086316 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56d700-11d6-49c2-8528-fb260568e8a4 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:14.086486 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56d700-11d6-49c2-8528-fb260568e8a4 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:14.086729 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56d700-11d6-49c2-8528-fb260568e8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:14.115200 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138f2f1-0e01-4611-af26-1bff47770c60 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:14.142915 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-5f56d700-11d6-49c2-8528-fb260568e8a4 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:14.144149 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-5f56d700-11d6-49c2-8528-fb260568e8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:14.154865 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08788d68-8e7c-44fb-b3c4-86e959ed34f8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=E_kMBwUGQ3uUb73g1dChyQ, audit_chain_id=['E_kMBwUGQ3uUb73g1dChyQ']) at 0x7f8a0fe040d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:14.157084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08788d68-8e7c-44fb-b3c4-86e959ed34f8 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:14.157572 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08788d68-8e7c-44fb-b3c4-86e959ed34f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:14.158080 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08788d68-8e7c-44fb-b3c4-86e959ed34f8 None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:14.159966 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08788d68-8e7c-44fb-b3c4-86e959ed34f8 None admin] RBAC: Authorizing `identity:get_project(project_id=c312d273f41543edafc129654a960b7b)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:14.161656 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08788d68-8e7c-44fb-b3c4-86e959ed34f8 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:14.163801 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 55/112] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:13 2022] GET /identity/v3/projects/c312d273f41543edafc129654a960b7b => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:14.164995 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08788d68-8e7c-44fb-b3c4-86e959ed34f8 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:14.169881 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:14.278308 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08788d68-8e7c-44fb-b3c4-86e959ed34f8 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:14.282650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 58/113] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:14.286421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56d700-11d6-49c2-8528-fb260568e8a4 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:14.331194 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb4fc9-fd2f-41c1-a25d-7fa51ab0b224 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Bcv2IzKMSAGDHuddzJ_H3w, audit_chain_id=['Bcv2IzKMSAGDHuddzJ_H3w']) at 0x7f8a0fe07a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:14.331824 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb4fc9-fd2f-41c1-a25d-7fa51ab0b224 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:14.332108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb4fc9-fd2f-41c1-a25d-7fa51ab0b224 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:14.332387 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb4fc9-fd2f-41c1-a25d-7fa51ab0b224 None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:14.333385 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb4fc9-fd2f-41c1-a25d-7fa51ab0b224 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:14.333730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb4fc9-fd2f-41c1-a25d-7fa51ab0b224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:14.335104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb4fc9-fd2f-41c1-a25d-7fa51ab0b224 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:14.343969 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 56/114] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:47:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:14.345215 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba0981-2ed2-4de3-b775-b2a65aba79d0 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:14.345348 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba0981-2ed2-4de3-b775-b2a65aba79d0 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:14.346528 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba0981-2ed2-4de3-b775-b2a65aba79d0 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:14.346826 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 57/115] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:14.347539 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba0981-2ed2-4de3-b775-b2a65aba79d0 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:14.384434 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:14.409734 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56d700-11d6-49c2-8528-fb260568e8a4 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:14.419967 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:14.447093 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1972e-5086-44f4-bb47-a3a689570bdb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=E_kMBwUGQ3uUb73g1dChyQ, audit_chain_id=['E_kMBwUGQ3uUb73g1dChyQ']) at 0x7f8a0fe66550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:14.447778 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1972e-5086-44f4-bb47-a3a689570bdb None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:14.448065 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1972e-5086-44f4-bb47-a3a689570bdb None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:14.448368 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1972e-5086-44f4-bb47-a3a689570bdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:14.449370 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1972e-5086-44f4-bb47-a3a689570bdb None admin] RBAC: Adding query filter params (role.id=862b3fa9d6834bd3b14681fc489500a7, scope.project.id=c312d273f41543edafc129654a960b7b, user.id=5874935317854b289ddc864c60faeac0) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:14.449477 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1972e-5086-44f4-bb47-a3a689570bdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:14.450968 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1972e-5086-44f4-bb47-a3a689570bdb None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:14.465606 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 59/116] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:47:14 2022] GET /identity/v3/role_assignments?user.id=5874935317854b289ddc864c60faeac0&scope.project.id=c312d273f41543edafc129654a960b7b&role.id=862b3fa9d6834bd3b14681fc489500a7 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:14.465606 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2b684-9e7f-4b52-92bc-91de3f948b14 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:14.465606 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2b684-9e7f-4b52-92bc-91de3f948b14 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:14.465606 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2b684-9e7f-4b52-92bc-91de3f948b14 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:14.465606 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 60/117] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:14.465606 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2b684-9e7f-4b52-92bc-91de3f948b14 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:14.488375 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba0981-2ed2-4de3-b775-b2a65aba79d0 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:14.537879 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728a769-19b1-4538-bfb0-f0a1e2839ee2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dKyEVGrVQWSzpf09QnePMg, audit_chain_id=['dKyEVGrVQWSzpf09QnePMg']) at 0x7f8a0fe89ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:14.538809 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728a769-19b1-4538-bfb0-f0a1e2839ee2 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:14.539153 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728a769-19b1-4538-bfb0-f0a1e2839ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:14.539437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728a769-19b1-4538-bfb0-f0a1e2839ee2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:14.562925 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728a769-19b1-4538-bfb0-f0a1e2839ee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:14.568952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-a728a769-19b1-4538-bfb0-f0a1e2839ee2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:14.568952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:14.568952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:14.568952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:14.568952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:14.568952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:14.568952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:14.568952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:14.568952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:14.568952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:14.568952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:14.568952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:14.568952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:14.568952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:14.568952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:14.568952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:14.570184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:14.570184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:14.570184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:14.570184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:14.570184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:14.570184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:14.570184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:14.570184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:14.570184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:14.570184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:14.570184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:14.570184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:14.570184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:14.570184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:14.570184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:14.570184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:14.576071 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:14.576071 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:14.576071 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:14.576071 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:14.576071 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:14.576071 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:14.576071 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:14.576071 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:14.576071 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:14.576071 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:14.576071 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:14.576071 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:47:14.576071 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 58/118] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:14.576071 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23031c-d5b9-4244-848d-b174ffcaa15c None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:14.576767 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23031c-d5b9-4244-848d-b174ffcaa15c None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:14.576767 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23031c-d5b9-4244-848d-b174ffcaa15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:14.597551 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-bd23031c-d5b9-4244-848d-b174ffcaa15c None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:14.599702 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-bd23031c-d5b9-4244-848d-b174ffcaa15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:14.614168 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2b684-9e7f-4b52-92bc-91de3f948b14 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:14.652732 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3520b7-1f22-499d-80cb-5a4ea76be046 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Bcv2IzKMSAGDHuddzJ_H3w, audit_chain_id=['Bcv2IzKMSAGDHuddzJ_H3w']) at 0x7f8a0fdc1b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:14.653726 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3520b7-1f22-499d-80cb-5a4ea76be046 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:14.654162 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3520b7-1f22-499d-80cb-5a4ea76be046 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:14.654561 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3520b7-1f22-499d-80cb-5a4ea76be046 None admin] PATH_INFO: `/v3/users/e088deb3ffe740c48565d7c35c2e9bc9` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:14.656852 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3520b7-1f22-499d-80cb-5a4ea76be046 None admin] RBAC: Authorizing `identity:get_user(user_id=e088deb3ffe740c48565d7c35c2e9bc9)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:14.658451 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3520b7-1f22-499d-80cb-5a4ea76be046 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:14.664767 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 61/119] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:14 2022] GET /identity/v3/users/e088deb3ffe740c48565d7c35c2e9bc9 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:14.666621 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef2311-d61b-46ad-90d7-c47e57d047e2 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:14.666986 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef2311-d61b-46ad-90d7-c47e57d047e2 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:14.667340 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef2311-d61b-46ad-90d7-c47e57d047e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:14.691278 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-f7ef2311-d61b-46ad-90d7-c47e57d047e2 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:14.692499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-f7ef2311-d61b-46ad-90d7-c47e57d047e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:14.694761 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:14.704214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 59/120] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:14.705143 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23031c-d5b9-4244-848d-b174ffcaa15c None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:14.773603 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:14.791224 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 62/121] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:14.792192 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef2311-d61b-46ad-90d7-c47e57d047e2 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:14.831445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23031c-d5b9-4244-848d-b174ffcaa15c None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:14.883583 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f190a25-eadd-4ed8-b17d-26ca2c5efbc2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dKyEVGrVQWSzpf09QnePMg, audit_chain_id=['dKyEVGrVQWSzpf09QnePMg']) at 0x7f8a0fe26a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:14.884216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f190a25-eadd-4ed8-b17d-26ca2c5efbc2 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:14.884507 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f190a25-eadd-4ed8-b17d-26ca2c5efbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:14.884787 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f190a25-eadd-4ed8-b17d-26ca2c5efbc2 None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:14.885520 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f190a25-eadd-4ed8-b17d-26ca2c5efbc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:14.885859 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f190a25-eadd-4ed8-b17d-26ca2c5efbc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:14.887268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f190a25-eadd-4ed8-b17d-26ca2c5efbc2 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:14.896874 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 60/122] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:14.897962 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f190a25-eadd-4ed8-b17d-26ca2c5efbc2 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:14.913752 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef2311-d61b-46ad-90d7-c47e57d047e2 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:14.958396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99664181-1b94-44e3-82df-6728f79f43db None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Bcv2IzKMSAGDHuddzJ_H3w, audit_chain_id=['Bcv2IzKMSAGDHuddzJ_H3w']) at 0x7f8a0fe427c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:14.959250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99664181-1b94-44e3-82df-6728f79f43db None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:14.959539 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99664181-1b94-44e3-82df-6728f79f43db None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:14.960246 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99664181-1b94-44e3-82df-6728f79f43db None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:14.961852 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99664181-1b94-44e3-82df-6728f79f43db None admin] RBAC: Authorizing `identity:get_project(project_id=c312d273f41543edafc129654a960b7b)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:14.963965 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99664181-1b94-44e3-82df-6728f79f43db None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:14.966199 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 63/123] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:14 2022] GET /identity/v3/projects/c312d273f41543edafc129654a960b7b => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:14.968477 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99664181-1b94-44e3-82df-6728f79f43db None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:14.985050 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:15.021086 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f190a25-eadd-4ed8-b17d-26ca2c5efbc2 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:15.039295 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:15.060147 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951058a7-e64c-43d5-9253-a0a80e8bb3d9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gpgBjLVtR1azOxNOhOQN9A, audit_chain_id=['gpgBjLVtR1azOxNOhOQN9A']) at 0x7f8a0feed100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:15.060879 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951058a7-e64c-43d5-9253-a0a80e8bb3d9 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:15.061296 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951058a7-e64c-43d5-9253-a0a80e8bb3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:15.061768 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951058a7-e64c-43d5-9253-a0a80e8bb3d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:15.073158 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951058a7-e64c-43d5-9253-a0a80e8bb3d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:15.079631 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-951058a7-e64c-43d5-9253-a0a80e8bb3d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:47:15.079631 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:15.079631 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:15.079631 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:15.079631 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:15.079631 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:15.079631 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:15.079631 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:15.079631 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:15.079631 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:15.079631 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:15.079631 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:15.079631 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:15.079631 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:15.079631 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:15.079631 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:15.080677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:15.080677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:15.080677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:15.080677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:15.080677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:15.080677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:15.080677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:15.080677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:15.080677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:15.080677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:15.080677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:15.080677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:15.080677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:15.080677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:15.080677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:15.080677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:15.081664 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:15.081664 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:15.081664 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:15.081664 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:15.081664 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:15.081664 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:15.081664 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:15.081664 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:15.081664 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:15.081664 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:15.081664 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:47:15.081664 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:47:15.088335 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 61/124] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 22:47:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:15.089269 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951058a7-e64c-43d5-9253-a0a80e8bb3d9 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:15.105626 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99664181-1b94-44e3-82df-6728f79f43db None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:15.154723 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba718e3-129e-4245-9a2a-18c3f13d7ab6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SLzfyxqtQm69rKBvcN_bIA, audit_chain_id=['SLzfyxqtQm69rKBvcN_bIA']) at 0x7f8a0fe1c220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:15.156066 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba718e3-129e-4245-9a2a-18c3f13d7ab6 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:15.156770 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba718e3-129e-4245-9a2a-18c3f13d7ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:15.157197 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba718e3-129e-4245-9a2a-18c3f13d7ab6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:15.171978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba718e3-129e-4245-9a2a-18c3f13d7ab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:15.179520 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-0ba718e3-129e-4245-9a2a-18c3f13d7ab6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:15.179520 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:15.179520 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:15.179520 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:15.179520 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:15.179520 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:15.179520 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:15.179520 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:15.179520 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:15.179520 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:15.179520 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:15.179520 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:15.179520 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:15.179520 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:15.179520 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:15.179520 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:15.180588 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:15.180588 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:15.180588 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:15.180588 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:15.180588 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:15.180588 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:15.180588 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:15.180588 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:15.180588 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:15.180588 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:15.180588 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:15.180588 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:15.180588 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:15.180588 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:15.180588 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:15.180588 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:15.181555 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:15.181555 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:15.181555 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:15.181555 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:15.181555 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:15.181555 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:15.181555 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:15.181555 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:15.181555 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:15.181555 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:15.181555 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:15.181555 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:15.184283 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 64/125] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:15.185468 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba718e3-129e-4245-9a2a-18c3f13d7ab6 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:15.204393 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951058a7-e64c-43d5-9253-a0a80e8bb3d9 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:15.243428 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47716b3-2a21-4bb5-a095-2743ea9df671 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dKyEVGrVQWSzpf09QnePMg, audit_chain_id=['dKyEVGrVQWSzpf09QnePMg']) at 0x7f8a0fe27eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:15.244249 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47716b3-2a21-4bb5-a095-2743ea9df671 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:15.244725 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47716b3-2a21-4bb5-a095-2743ea9df671 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:15.245023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47716b3-2a21-4bb5-a095-2743ea9df671 None admin] PATH_INFO: `/v3/users/e088deb3ffe740c48565d7c35c2e9bc9` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:15.246371 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47716b3-2a21-4bb5-a095-2743ea9df671 None admin] RBAC: Authorizing `identity:get_user(user_id=e088deb3ffe740c48565d7c35c2e9bc9)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:15.247950 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47716b3-2a21-4bb5-a095-2743ea9df671 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:15.250871 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 62/126] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:15 2022] GET /identity/v3/users/e088deb3ffe740c48565d7c35c2e9bc9 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:15.251765 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47716b3-2a21-4bb5-a095-2743ea9df671 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:15.274714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:15.305165 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:15.330728 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba718e3-129e-4245-9a2a-18c3f13d7ab6 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:15.374319 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb708f-9b55-4f32-93cb-b15a72794136 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Bcv2IzKMSAGDHuddzJ_H3w, audit_chain_id=['Bcv2IzKMSAGDHuddzJ_H3w']) at 0x7f8a0fe555b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:15.375422 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb708f-9b55-4f32-93cb-b15a72794136 None admin] REQUEST_METHOD: `PUT` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:15.375813 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb708f-9b55-4f32-93cb-b15a72794136 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:15.376198 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb708f-9b55-4f32-93cb-b15a72794136 None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b/users/e088deb3ffe740c48565d7c35c2e9bc9/roles/e0342a5e42664f35948f522071411514` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:15.377558 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47716b3-2a21-4bb5-a095-2743ea9df671 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:15.379380 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb708f-9b55-4f32-93cb-b15a72794136 None admin] RBAC: Authorizing `identity:create_grant(project_id=c312d273f41543edafc129654a960b7b, user_id=e088deb3ffe740c48565d7c35c2e9bc9, role_id=e0342a5e42664f35948f522071411514)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:15.381788 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb708f-9b55-4f32-93cb-b15a72794136 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:15.402936 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 65/127] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 22:47:15 2022] PUT /identity/v3/projects/c312d273f41543edafc129654a960b7b/users/e088deb3ffe740c48565d7c35c2e9bc9/roles/e0342a5e42664f35948f522071411514 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:47:15.403741 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb708f-9b55-4f32-93cb-b15a72794136 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:15.443250 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba56286-0218-4db3-b616-412131046a9b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gpgBjLVtR1azOxNOhOQN9A, audit_chain_id=['gpgBjLVtR1azOxNOhOQN9A']) at 0x7f8a0fe1e940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:15.443905 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba56286-0218-4db3-b616-412131046a9b None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:15.444200 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba56286-0218-4db3-b616-412131046a9b None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:15.444484 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba56286-0218-4db3-b616-412131046a9b None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:15.445230 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba56286-0218-4db3-b616-412131046a9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:15.445541 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba56286-0218-4db3-b616-412131046a9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:15.448097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba56286-0218-4db3-b616-412131046a9b None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:15.468599 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 63/128] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:15.475955 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba56286-0218-4db3-b616-412131046a9b None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:15.633433 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb708f-9b55-4f32-93cb-b15a72794136 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:15.672785 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:15.674399 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba56286-0218-4db3-b616-412131046a9b None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:15.683773 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:15.690991 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847f504-72fc-4169-8e78-5c3722768648 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SLzfyxqtQm69rKBvcN_bIA, audit_chain_id=['SLzfyxqtQm69rKBvcN_bIA']) at 0x7f8a0fe64460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:15.693029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847f504-72fc-4169-8e78-5c3722768648 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:15.693732 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847f504-72fc-4169-8e78-5c3722768648 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:15.694162 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847f504-72fc-4169-8e78-5c3722768648 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:15.695286 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847f504-72fc-4169-8e78-5c3722768648 None admin] RBAC: Adding query filter params (name=member) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:15.696126 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847f504-72fc-4169-8e78-5c3722768648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:15.697734 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847f504-72fc-4169-8e78-5c3722768648 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:15.711956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 66/129] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:15.713203 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847f504-72fc-4169-8e78-5c3722768648 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:15.718886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf4c89-b80a-4158-b15e-5db8f1f903b9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dKyEVGrVQWSzpf09QnePMg, audit_chain_id=['dKyEVGrVQWSzpf09QnePMg']) at 0x7f8a0fe0ed60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:15.719554 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf4c89-b80a-4158-b15e-5db8f1f903b9 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:15.719846 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf4c89-b80a-4158-b15e-5db8f1f903b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:15.720132 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf4c89-b80a-4158-b15e-5db8f1f903b9 None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:15.721333 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf4c89-b80a-4158-b15e-5db8f1f903b9 None admin] RBAC: Authorizing `identity:get_project(project_id=c312d273f41543edafc129654a960b7b)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:15.722863 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf4c89-b80a-4158-b15e-5db8f1f903b9 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:15.724842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 64/130] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:15 2022] GET /identity/v3/projects/c312d273f41543edafc129654a960b7b => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:15.725448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf4c89-b80a-4158-b15e-5db8f1f903b9 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:15.848356 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847f504-72fc-4169-8e78-5c3722768648 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:15.850182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf4c89-b80a-4158-b15e-5db8f1f903b9 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:15.883909 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ad10b-0a34-4dae-a315-3ff6ac404e4b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gpgBjLVtR1azOxNOhOQN9A, audit_chain_id=['gpgBjLVtR1azOxNOhOQN9A']) at 0x7f8a0fe5b190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:15.884490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ad10b-0a34-4dae-a315-3ff6ac404e4b None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:15.884777 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ad10b-0a34-4dae-a315-3ff6ac404e4b None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:15.885059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ad10b-0a34-4dae-a315-3ff6ac404e4b None admin] PATH_INFO: `/v3/users/21915d6d53c54080a8c4d15c72508181` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:15.886270 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ad10b-0a34-4dae-a315-3ff6ac404e4b None admin] RBAC: Authorizing `identity:get_user(user_id=21915d6d53c54080a8c4d15c72508181)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:15.887782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ad10b-0a34-4dae-a315-3ff6ac404e4b None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:15.890404 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 67/131] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:15 2022] GET /identity/v3/users/21915d6d53c54080a8c4d15c72508181 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:15.891153 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ad10b-0a34-4dae-a315-3ff6ac404e4b None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:15.896374 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa5783-841b-40d7-93ee-aa7e8d6ff33b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SLzfyxqtQm69rKBvcN_bIA, audit_chain_id=['SLzfyxqtQm69rKBvcN_bIA']) at 0x7f8a0fe89ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:15.897208 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa5783-841b-40d7-93ee-aa7e8d6ff33b None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:15.897683 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa5783-841b-40d7-93ee-aa7e8d6ff33b None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:15.898107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa5783-841b-40d7-93ee-aa7e8d6ff33b None admin] PATH_INFO: `/v3/users/e088deb3ffe740c48565d7c35c2e9bc9` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:15.900764 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa5783-841b-40d7-93ee-aa7e8d6ff33b None admin] RBAC: Authorizing `identity:get_user(user_id=e088deb3ffe740c48565d7c35c2e9bc9)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:15.902379 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa5783-841b-40d7-93ee-aa7e8d6ff33b None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:15.904123 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 65/132] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:15 2022] GET /identity/v3/users/e088deb3ffe740c48565d7c35c2e9bc9 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:15.906497 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa5783-841b-40d7-93ee-aa7e8d6ff33b None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:15.961343 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:15.969628 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:16.012050 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ad10b-0a34-4dae-a315-3ff6ac404e4b None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:16.054870 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa5783-841b-40d7-93ee-aa7e8d6ff33b None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:16.063347 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3f7b5-b1f6-4b96-b242-758451e2ed81 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=dKyEVGrVQWSzpf09QnePMg, audit_chain_id=['dKyEVGrVQWSzpf09QnePMg']) at 0x7f8a0fe55160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:16.064131 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3f7b5-b1f6-4b96-b242-758451e2ed81 None admin] REQUEST_METHOD: `PUT` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:16.064494 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3f7b5-b1f6-4b96-b242-758451e2ed81 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:16.064848 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3f7b5-b1f6-4b96-b242-758451e2ed81 None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b/users/e088deb3ffe740c48565d7c35c2e9bc9/roles/c57f45d724fe45009701c9b2706d661c` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:16.067188 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3f7b5-b1f6-4b96-b242-758451e2ed81 None admin] RBAC: Authorizing `identity:create_grant(project_id=c312d273f41543edafc129654a960b7b, user_id=e088deb3ffe740c48565d7c35c2e9bc9, role_id=c57f45d724fe45009701c9b2706d661c)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:16.068718 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3f7b5-b1f6-4b96-b242-758451e2ed81 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:16.095165 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 68/133] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 22:47:15 2022] PUT /identity/v3/projects/c312d273f41543edafc129654a960b7b/users/e088deb3ffe740c48565d7c35c2e9bc9/roles/c57f45d724fe45009701c9b2706d661c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:47:16.096112 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3f7b5-b1f6-4b96-b242-758451e2ed81 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:16.098695 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c99f3-3ab8-42f8-a3c5-0024112cc72a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gpgBjLVtR1azOxNOhOQN9A, audit_chain_id=['gpgBjLVtR1azOxNOhOQN9A']) at 0x7f8a0fea1a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:16.099605 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c99f3-3ab8-42f8-a3c5-0024112cc72a None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:16.100069 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c99f3-3ab8-42f8-a3c5-0024112cc72a None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:16.100527 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c99f3-3ab8-42f8-a3c5-0024112cc72a None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:16.102356 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c99f3-3ab8-42f8-a3c5-0024112cc72a None admin] RBAC: Authorizing `identity:get_project(project_id=c312d273f41543edafc129654a960b7b)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:16.104084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c99f3-3ab8-42f8-a3c5-0024112cc72a None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:16.106306 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 66/134] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:15 2022] GET /identity/v3/projects/c312d273f41543edafc129654a960b7b => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:16.112866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c99f3-3ab8-42f8-a3c5-0024112cc72a None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:16.229700 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c99f3-3ab8-42f8-a3c5-0024112cc72a None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:16.246258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:16.270219 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b515d9-082d-4868-85f5-e20e7c00050e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gpgBjLVtR1azOxNOhOQN9A, audit_chain_id=['gpgBjLVtR1azOxNOhOQN9A']) at 0x7f8a0fe89760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:16.271236 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b515d9-082d-4868-85f5-e20e7c00050e None admin] REQUEST_METHOD: `PUT` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:16.271699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b515d9-082d-4868-85f5-e20e7c00050e None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:16.272171 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b515d9-082d-4868-85f5-e20e7c00050e None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b/users/21915d6d53c54080a8c4d15c72508181/roles/6ca03befbf3a456eae350bc7e583488f` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:16.274611 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b515d9-082d-4868-85f5-e20e7c00050e None admin] RBAC: Authorizing `identity:create_grant(project_id=c312d273f41543edafc129654a960b7b, user_id=21915d6d53c54080a8c4d15c72508181, role_id=6ca03befbf3a456eae350bc7e583488f)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:16.276380 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b515d9-082d-4868-85f5-e20e7c00050e None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:16.293599 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 67/135] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 22:47:16 2022] PUT /identity/v3/projects/c312d273f41543edafc129654a960b7b/users/21915d6d53c54080a8c4d15c72508181/roles/6ca03befbf3a456eae350bc7e583488f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:47:16.314507 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3f7b5-b1f6-4b96-b242-758451e2ed81 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:16.335132 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7ae01-9d6e-47b3-a77d-91e095e756b6 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:16.335789 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7ae01-9d6e-47b3-a77d-91e095e756b6 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:16.336308 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7ae01-9d6e-47b3-a77d-91e095e756b6 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:16.339231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 68/136] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:16.344320 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bf6f3-2864-4d22-ac71-99b86da1627a None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:16.344882 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bf6f3-2864-4d22-ac71-99b86da1627a None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:16.345336 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bf6f3-2864-4d22-ac71-99b86da1627a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:16.348877 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:16.376506 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-2c9bf6f3-2864-4d22-ac71-99b86da1627a None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:16.378279 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-2c9bf6f3-2864-4d22-ac71-99b86da1627a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:16.394386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9fc56-b204-42c9-87af-5fb62a74bc1b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SLzfyxqtQm69rKBvcN_bIA, audit_chain_id=['SLzfyxqtQm69rKBvcN_bIA']) at 0x7f8a0fe64ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:16.395342 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9fc56-b204-42c9-87af-5fb62a74bc1b None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:16.395342 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9fc56-b204-42c9-87af-5fb62a74bc1b None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:16.401838 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9fc56-b204-42c9-87af-5fb62a74bc1b None admin] PATH_INFO: `/v3/projects/89b71af52ea14593953aa38fdefe4fa1` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:16.403388 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9fc56-b204-42c9-87af-5fb62a74bc1b None admin] RBAC: Authorizing `identity:get_project(project_id=89b71af52ea14593953aa38fdefe4fa1)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:16.405023 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9fc56-b204-42c9-87af-5fb62a74bc1b None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:16.406998 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 69/137] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:16 2022] GET /identity/v3/projects/89b71af52ea14593953aa38fdefe4fa1 => generated 312 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:16.413627 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9fc56-b204-42c9-87af-5fb62a74bc1b None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:16.514671 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 69/138] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:47:16.572668 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9fc56-b204-42c9-87af-5fb62a74bc1b None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:16.590536 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bf6f3-2864-4d22-ac71-99b86da1627a None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:16.653505 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68319841-ea6a-42aa-9bd0-1b54a960fdd0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SLzfyxqtQm69rKBvcN_bIA, audit_chain_id=['SLzfyxqtQm69rKBvcN_bIA']) at 0x7f8a0fe5be20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:16.656077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68319841-ea6a-42aa-9bd0-1b54a960fdd0 None admin] REQUEST_METHOD: `PUT` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:16.661278 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68319841-ea6a-42aa-9bd0-1b54a960fdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:16.661799 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68319841-ea6a-42aa-9bd0-1b54a960fdd0 None admin] PATH_INFO: `/v3/projects/89b71af52ea14593953aa38fdefe4fa1/users/e088deb3ffe740c48565d7c35c2e9bc9/roles/c57f45d724fe45009701c9b2706d661c` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:16.664172 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68319841-ea6a-42aa-9bd0-1b54a960fdd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=89b71af52ea14593953aa38fdefe4fa1, user_id=e088deb3ffe740c48565d7c35c2e9bc9, role_id=c57f45d724fe45009701c9b2706d661c)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:16.665894 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68319841-ea6a-42aa-9bd0-1b54a960fdd0 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:16.690143 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 70/139] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 22:47:16 2022] PUT /identity/v3/projects/89b71af52ea14593953aa38fdefe4fa1/users/e088deb3ffe740c48565d7c35c2e9bc9/roles/c57f45d724fe45009701c9b2706d661c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:47:16.758335 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:16.764787 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bf6f3-2864-4d22-ac71-99b86da1627a None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:16.827957 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf8e66-ec79-4cad-8194-9609ce0e3fa2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WW48ua8PTdG1lECzcGBJ_A, audit_chain_id=['WW48ua8PTdG1lECzcGBJ_A']) at 0x7f8a14202580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:16.828653 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf8e66-ec79-4cad-8194-9609ce0e3fa2 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:16.828942 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf8e66-ec79-4cad-8194-9609ce0e3fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:16.829221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf8e66-ec79-4cad-8194-9609ce0e3fa2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:16.830625 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf8e66-ec79-4cad-8194-9609ce0e3fa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:16.832129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaf8e66-ec79-4cad-8194-9609ce0e3fa2 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:16.833805 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 70/140] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:47:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:16.839391 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68319841-ea6a-42aa-9bd0-1b54a960fdd0 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:16.921295 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:16.990048 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68319841-ea6a-42aa-9bd0-1b54a960fdd0 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:17.034003 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7497fc1-986d-4fad-bfc7-d30cf5db8192 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WW48ua8PTdG1lECzcGBJ_A, audit_chain_id=['WW48ua8PTdG1lECzcGBJ_A']) at 0x7f8a0fe20c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:17.034569 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7497fc1-986d-4fad-bfc7-d30cf5db8192 None admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:17.034855 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7497fc1-986d-4fad-bfc7-d30cf5db8192 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:17.035137 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7497fc1-986d-4fad-bfc7-d30cf5db8192 None admin] PATH_INFO: `/v3/users` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:17.035840 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7497fc1-986d-4fad-bfc7-d30cf5db8192 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:17.037319 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7497fc1-986d-4fad-bfc7-d30cf5db8192 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:17.071266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 71/141] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 22:47:16 2022] POST /identity/v3/users => generated 283 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:47:17.323921 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921ab9d-69bb-4320-8894-67d3953acd82 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:17.324264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921ab9d-69bb-4320-8894-67d3953acd82 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:17.324375 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921ab9d-69bb-4320-8894-67d3953acd82 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:17.325791 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 71/142] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:17.332166 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cf972-32ba-4623-a656-2f69e2a21fa5 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:17.332456 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cf972-32ba-4623-a656-2f69e2a21fa5 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:17.332741 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cf972-32ba-4623-a656-2f69e2a21fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:17.369641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-e03cf972-32ba-4623-a656-2f69e2a21fa5 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:17.370854 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-e03cf972-32ba-4623-a656-2f69e2a21fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:17.476695 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 72/143] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:47:17.520025 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921ab9d-69bb-4320-8894-67d3953acd82 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:17.654269 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921ab9d-69bb-4320-8894-67d3953acd82 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:17.698662 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59cd05-87f1-4f53-994d-e1266de51bac None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Lxp9G8SZS-W9QQyksyqH7A, audit_chain_id=['Lxp9G8SZS-W9QQyksyqH7A']) at 0x7f8a0fe30f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:17.699674 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59cd05-87f1-4f53-994d-e1266de51bac None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:17.700167 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59cd05-87f1-4f53-994d-e1266de51bac None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:17.700635 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59cd05-87f1-4f53-994d-e1266de51bac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:17.711877 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59cd05-87f1-4f53-994d-e1266de51bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:17.717875 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-ed59cd05-87f1-4f53-994d-e1266de51bac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:47:17.717875 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:17.717875 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:17.717875 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:17.717875 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:17.717875 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:17.717875 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:17.717875 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:17.717875 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:17.717875 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:17.717875 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:17.717875 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:17.717875 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:17.717875 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:17.717875 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:17.717875 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:17.719170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:17.719170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:17.719170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:17.719170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:17.719170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:17.719170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:17.719170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:17.719170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:17.719170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:17.719170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:17.719170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:17.719170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:17.719170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:17.719170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:17.719170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:17.719170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:17.720025 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:17.720025 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:17.720025 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:17.720025 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:17.720025 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:17.720025 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:17.720025 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:17.720025 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:17.720025 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:17.720025 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:17.720025 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:47:17.720025 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:47:17.724386 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 72/144] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:17.728236 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cf972-32ba-4623-a656-2f69e2a21fa5 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:17.781680 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:17.873920 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cf972-32ba-4623-a656-2f69e2a21fa5 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:17.924646 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c49ce-9c4d-493a-a200-6db8eca33a6e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Lxp9G8SZS-W9QQyksyqH7A, audit_chain_id=['Lxp9G8SZS-W9QQyksyqH7A']) at 0x7f8a0fe64970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:17.925673 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c49ce-9c4d-493a-a200-6db8eca33a6e None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:17.926163 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c49ce-9c4d-493a-a200-6db8eca33a6e None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:17.926651 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c49ce-9c4d-493a-a200-6db8eca33a6e None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:17.927728 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c49ce-9c4d-493a-a200-6db8eca33a6e None admin] RBAC: Adding query filter params (name=reader) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:17.928236 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c49ce-9c4d-493a-a200-6db8eca33a6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:17.929866 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c49ce-9c4d-493a-a200-6db8eca33a6e None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:17.942236 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 73/145] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:17.947416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59cd05-87f1-4f53-994d-e1266de51bac None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:17.983084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:18.076215 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59cd05-87f1-4f53-994d-e1266de51bac None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:18.121523 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe9f16-ebe6-4132-87fd-2108f0f02114 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Lxp9G8SZS-W9QQyksyqH7A, audit_chain_id=['Lxp9G8SZS-W9QQyksyqH7A']) at 0x7f8a0fe25340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:18.122303 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe9f16-ebe6-4132-87fd-2108f0f02114 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:18.122593 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe9f16-ebe6-4132-87fd-2108f0f02114 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:18.122877 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe9f16-ebe6-4132-87fd-2108f0f02114 None admin] PATH_INFO: `/v3/users/5874935317854b289ddc864c60faeac0` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:18.124116 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe9f16-ebe6-4132-87fd-2108f0f02114 None admin] RBAC: Authorizing `identity:get_user(user_id=5874935317854b289ddc864c60faeac0)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:18.125586 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe9f16-ebe6-4132-87fd-2108f0f02114 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:18.127513 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 73/146] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:17 2022] GET /identity/v3/users/5874935317854b289ddc864c60faeac0 => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:18.132814 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c49ce-9c4d-493a-a200-6db8eca33a6e None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:18.273795 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:18.289167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c49ce-9c4d-493a-a200-6db8eca33a6e None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:18.326265 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec01be-f48b-444c-85d9-9fc8315191ac None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Lxp9G8SZS-W9QQyksyqH7A, audit_chain_id=['Lxp9G8SZS-W9QQyksyqH7A']) at 0x7f8a0fdd2310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:18.327460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec01be-f48b-444c-85d9-9fc8315191ac None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:18.327950 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec01be-f48b-444c-85d9-9fc8315191ac None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:18.328430 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec01be-f48b-444c-85d9-9fc8315191ac None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:18.329886 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec01be-f48b-444c-85d9-9fc8315191ac None admin] RBAC: Authorizing `identity:get_project(project_id=c312d273f41543edafc129654a960b7b)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:18.331566 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec01be-f48b-444c-85d9-9fc8315191ac None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:18.333473 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 74/147] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:18 2022] GET /identity/v3/projects/c312d273f41543edafc129654a960b7b => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:18.339262 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe9f16-ebe6-4132-87fd-2108f0f02114 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:18.472611 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:18.481609 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe9f16-ebe6-4132-87fd-2108f0f02114 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:18.525448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de82552-26af-4852-93d2-a367fe11dc84 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Lxp9G8SZS-W9QQyksyqH7A, audit_chain_id=['Lxp9G8SZS-W9QQyksyqH7A']) at 0x7f8a0fe710d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:18.526083 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de82552-26af-4852-93d2-a367fe11dc84 None admin] REQUEST_METHOD: `PUT` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:18.526381 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de82552-26af-4852-93d2-a367fe11dc84 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:18.526662 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de82552-26af-4852-93d2-a367fe11dc84 None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b/users/5874935317854b289ddc864c60faeac0/roles/862b3fa9d6834bd3b14681fc489500a7` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:18.535018 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de82552-26af-4852-93d2-a367fe11dc84 None admin] RBAC: Authorizing `identity:create_grant(project_id=c312d273f41543edafc129654a960b7b, user_id=5874935317854b289ddc864c60faeac0, role_id=862b3fa9d6834bd3b14681fc489500a7)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:18.536589 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de82552-26af-4852-93d2-a367fe11dc84 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:18.557651 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 74/148] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 22:47:18 2022] PUT /identity/v3/projects/c312d273f41543edafc129654a960b7b/users/5874935317854b289ddc864c60faeac0/roles/862b3fa9d6834bd3b14681fc489500a7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:47:19.169044 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff30dc-e574-4de5-b36d-836bd0083e78 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:19.170087 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff30dc-e574-4de5-b36d-836bd0083e78 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:19.170786 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff30dc-e574-4de5-b36d-836bd0083e78 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:19.172569 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 75/149] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:19.182241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b31d5-5a43-4640-8373-791447732906 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:19.183158 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b31d5-5a43-4640-8373-791447732906 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:19.183646 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b31d5-5a43-4640-8373-791447732906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:19.207109 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-ea7b31d5-5a43-4640-8373-791447732906 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:19.208687 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-ea7b31d5-5a43-4640-8373-791447732906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:19.298410 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 75/150] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:19.338483 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff30dc-e574-4de5-b36d-836bd0083e78 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:19.460359 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff30dc-e574-4de5-b36d-836bd0083e78 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:19.506222 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e76782-ce13-440c-be62-9a1d94d63d00 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:19.506848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e76782-ce13-440c-be62-9a1d94d63d00 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:19.507334 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e76782-ce13-440c-be62-9a1d94d63d00 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:19.508978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 76/151] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:47:19.517940 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692180a-db94-41e8-abfa-a7a42de2c377 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UzqtEMj4RaOt-5GWr0XXeA, audit_chain_id=['UzqtEMj4RaOt-5GWr0XXeA']) at 0x7f8a0fe55d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:19.518951 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692180a-db94-41e8-abfa-a7a42de2c377 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:19.519439 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692180a-db94-41e8-abfa-a7a42de2c377 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:19.519916 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692180a-db94-41e8-abfa-a7a42de2c377 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:19.527223 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a9b45-b522-4318-986a-c0e7fb76da7d None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:19.527844 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a9b45-b522-4318-986a-c0e7fb76da7d None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:19.528352 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a9b45-b522-4318-986a-c0e7fb76da7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:19.553768 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692180a-db94-41e8-abfa-a7a42de2c377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:19.559645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-5692180a-db94-41e8-abfa-a7a42de2c377 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:19.559645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:19.559645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:19.559645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:19.559645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:19.559645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:19.559645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:19.559645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:19.559645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:19.559645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:19.559645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:19.559645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:19.559645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:19.559645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:19.559645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:19.559645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:19.560542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:19.560542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:19.560542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:19.560542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:19.560542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:19.560542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:19.560542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:19.560542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:19.560542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:19.560542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:19.560542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:19.560542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:19.560542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:19.560542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:19.560542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:19.560542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:19.562006 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:19.562006 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:19.562006 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:19.562006 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:19.562006 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:19.562006 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:19.562006 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:19.562006 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:19.562006 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:19.562006 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:19.562006 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:19.562006 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:19.564507 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 76/152] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:47:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:19.568893 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-468a9b45-b522-4318-986a-c0e7fb76da7d None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:19.569039 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-468a9b45-b522-4318-986a-c0e7fb76da7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:19.570160 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692180a-db94-41e8-abfa-a7a42de2c377 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:19.612674 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:19.704263 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 77/153] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:47:19.748681 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a9b45-b522-4318-986a-c0e7fb76da7d None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:19.783313 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:19.787469 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692180a-db94-41e8-abfa-a7a42de2c377 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:19.852471 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d6dd4-b0c3-445c-90fa-cc90b880c777 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UzqtEMj4RaOt-5GWr0XXeA, audit_chain_id=['UzqtEMj4RaOt-5GWr0XXeA']) at 0x7f8a0fdde910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:19.853454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6dd4-b0c3-445c-90fa-cc90b880c777 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:19.853960 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6dd4-b0c3-445c-90fa-cc90b880c777 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:19.854474 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6dd4-b0c3-445c-90fa-cc90b880c777 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:19.855397 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d6dd4-b0c3-445c-90fa-cc90b880c777 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:19.855919 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d6dd4-b0c3-445c-90fa-cc90b880c777 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:19.857527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d6dd4-b0c3-445c-90fa-cc90b880c777 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:19.875740 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 77/154] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:47:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:19.881810 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d6dd4-b0c3-445c-90fa-cc90b880c777 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:19.972453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a9b45-b522-4318-986a-c0e7fb76da7d None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:20.038529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd0ef3-c646-487a-afc2-f79a09a9a54b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=COqcVduKRciTFGyFq6bFPw, audit_chain_id=['COqcVduKRciTFGyFq6bFPw']) at 0x7f8a0fe946a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:20.039108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd0ef3-c646-487a-afc2-f79a09a9a54b None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:20.039392 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd0ef3-c646-487a-afc2-f79a09a9a54b None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:20.039668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd0ef3-c646-487a-afc2-f79a09a9a54b None admin] PATH_INFO: `/v3/roles/member` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:20.066054 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:20.067217 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd0ef3-c646-487a-afc2-f79a09a9a54b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:20.072241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-afdd0ef3-c646-487a-afc2-f79a09a9a54b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:20.072241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:20.072241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:20.072241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:20.072241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:20.072241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:20.072241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:20.072241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:20.072241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:20.072241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:20.072241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:20.072241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:20.072241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:20.072241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:20.072241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:20.072241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:20.073097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:20.073097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:20.073097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:20.073097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:20.073097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:20.073097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:20.073097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:20.073097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:20.073097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:20.073097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:20.073097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:20.073097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:20.073097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:20.073097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:20.073097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:20.073097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:20.074275 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:20.074275 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:20.074275 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:20.074275 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:20.074275 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:20.074275 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:20.074275 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:20.074275 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:20.074275 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:20.074275 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:20.074275 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:20.074275 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:47:20.074275 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 78/155] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:47:20.079998 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd0ef3-c646-487a-afc2-f79a09a9a54b None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:20.110171 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d6dd4-b0c3-445c-90fa-cc90b880c777 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:20.226309 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e4b03-1d7d-4239-ab4d-b9bc59c9d854 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UzqtEMj4RaOt-5GWr0XXeA, audit_chain_id=['UzqtEMj4RaOt-5GWr0XXeA']) at 0x7f8a0fdd2a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:20.227761 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e4b03-1d7d-4239-ab4d-b9bc59c9d854 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:20.228332 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e4b03-1d7d-4239-ab4d-b9bc59c9d854 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:20.228797 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e4b03-1d7d-4239-ab4d-b9bc59c9d854 None admin] PATH_INFO: `/v3/users/e088deb3ffe740c48565d7c35c2e9bc9` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:20.234540 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e4b03-1d7d-4239-ab4d-b9bc59c9d854 None admin] RBAC: Authorizing `identity:get_user(user_id=e088deb3ffe740c48565d7c35c2e9bc9)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:20.235861 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:20.236383 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e4b03-1d7d-4239-ab4d-b9bc59c9d854 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:20.238642 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 78/156] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:19 2022] GET /identity/v3/users/e088deb3ffe740c48565d7c35c2e9bc9 => generated 275 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:20.240056 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbd3ec-9c42-4dd8-90d7-03a364a50eaf None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:20.240304 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbd3ec-9c42-4dd8-90d7-03a364a50eaf None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:20.240569 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbd3ec-9c42-4dd8-90d7-03a364a50eaf None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:20.241867 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 79/157] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:20.246619 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbd3ec-9c42-4dd8-90d7-03a364a50eaf None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:20.300374 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd0ef3-c646-487a-afc2-f79a09a9a54b None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:20.370531 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8616b8-3953-4559-984b-68aa722324ca None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=COqcVduKRciTFGyFq6bFPw, audit_chain_id=['COqcVduKRciTFGyFq6bFPw']) at 0x7f8a0fdc0910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:20.371482 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8616b8-3953-4559-984b-68aa722324ca None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:20.371762 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8616b8-3953-4559-984b-68aa722324ca None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:20.372044 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8616b8-3953-4559-984b-68aa722324ca None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:20.373052 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8616b8-3953-4559-984b-68aa722324ca None admin] RBAC: Adding query filter params (name=member) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:20.373366 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8616b8-3953-4559-984b-68aa722324ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:20.375395 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8616b8-3953-4559-984b-68aa722324ca None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:20.394132 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 79/158] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:20.395579 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6276d-76c3-46ae-9ee2-13cdfb7f86dc None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:20.396544 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6276d-76c3-46ae-9ee2-13cdfb7f86dc None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:20.396836 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6276d-76c3-46ae-9ee2-13cdfb7f86dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:20.428225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-dea6276d-76c3-46ae-9ee2-13cdfb7f86dc None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:20.429446 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-dea6276d-76c3-46ae-9ee2-13cdfb7f86dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:20.542277 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbd3ec-9c42-4dd8-90d7-03a364a50eaf None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:20.559020 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 80/159] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:20.559967 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6276d-76c3-46ae-9ee2-13cdfb7f86dc None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:20.613524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1082d-bf50-4b39-90fe-7feac6eef5ec None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UzqtEMj4RaOt-5GWr0XXeA, audit_chain_id=['UzqtEMj4RaOt-5GWr0XXeA']) at 0x7f8a0fde2070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:20.615038 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1082d-bf50-4b39-90fe-7feac6eef5ec None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:20.615675 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1082d-bf50-4b39-90fe-7feac6eef5ec None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:20.616376 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1082d-bf50-4b39-90fe-7feac6eef5ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:20.658818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:20.713775 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:20.782326 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1082d-bf50-4b39-90fe-7feac6eef5ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:20.783818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1082d-bf50-4b39-90fe-7feac6eef5ec None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:20.802402 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6276d-76c3-46ae-9ee2-13cdfb7f86dc None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:20.863268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e73fd-e334-48e1-9b53-7bf9ccc1b9ab None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=COqcVduKRciTFGyFq6bFPw, audit_chain_id=['COqcVduKRciTFGyFq6bFPw']) at 0x7f8a0fe14dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:20.863851 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e73fd-e334-48e1-9b53-7bf9ccc1b9ab None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:20.864138 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e73fd-e334-48e1-9b53-7bf9ccc1b9ab None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:20.864419 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e73fd-e334-48e1-9b53-7bf9ccc1b9ab None admin] PATH_INFO: `/v3/users/e088deb3ffe740c48565d7c35c2e9bc9` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:20.865629 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e73fd-e334-48e1-9b53-7bf9ccc1b9ab None admin] RBAC: Authorizing `identity:get_user(user_id=e088deb3ffe740c48565d7c35c2e9bc9)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:20.867227 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e73fd-e334-48e1-9b53-7bf9ccc1b9ab None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:20.868835 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 81/160] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:20 2022] GET /identity/v3/users/e088deb3ffe740c48565d7c35c2e9bc9 => generated 275 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:20.870045 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac0f4c-6c1f-4509-b0b1-47f486181196 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:20.870512 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac0f4c-6c1f-4509-b0b1-47f486181196 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:20.870858 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac0f4c-6c1f-4509-b0b1-47f486181196 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:20.872124 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 82/161] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:20.872829 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac0f4c-6c1f-4509-b0b1-47f486181196 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:21.093758 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 80/162] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 846 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:21.093758 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1082d-bf50-4b39-90fe-7feac6eef5ec None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:21.142625 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac0f4c-6c1f-4509-b0b1-47f486181196 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:21.213725 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:21.214694 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb193d-c873-47e9-bfc9-3dbf11e155a4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AeDXsY2CQn-9jaFJF13B9g, audit_chain_id=['AeDXsY2CQn-9jaFJF13B9g']) at 0x7f8a0fe26b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:21.215237 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb193d-c873-47e9-bfc9-3dbf11e155a4 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:21.215518 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb193d-c873-47e9-bfc9-3dbf11e155a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:21.215780 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb193d-c873-47e9-bfc9-3dbf11e155a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:21.224964 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:21.251087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb193d-c873-47e9-bfc9-3dbf11e155a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:21.263457 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-bafb193d-c873-47e9-bfc9-3dbf11e155a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:47:21.263457 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:21.263457 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:21.263457 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:21.263457 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:21.263457 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:21.263457 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:21.263457 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:21.263457 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:21.263457 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:21.263457 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:21.263457 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:21.263457 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:21.263457 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:21.263457 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:21.263457 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:21.264571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:21.264571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:21.264571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:21.264571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:21.264571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:21.264571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:21.264571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:21.264571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:21.264571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:21.264571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:21.264571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:21.264571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:21.264571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:21.264571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:21.264571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:21.264571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:21.265346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:21.265346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:21.265346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:21.265346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:21.265346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:21.265346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:21.265346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:21.265346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:21.265346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:21.265346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:21.265346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:47:21.265346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:47:21.265346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 83/163] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 22:47:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:21.266017 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f20f0-930b-40d0-bf07-5ab3998ba3db None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:21.266592 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f20f0-930b-40d0-bf07-5ab3998ba3db None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:21.266592 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f20f0-930b-40d0-bf07-5ab3998ba3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:21.296668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-257f20f0-930b-40d0-bf07-5ab3998ba3db None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:21.298060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-257f20f0-930b-40d0-bf07-5ab3998ba3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:21.336413 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1082d-bf50-4b39-90fe-7feac6eef5ec None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:21.401910 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954976f-ecb7-4931-93af-77622be69594 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=COqcVduKRciTFGyFq6bFPw, audit_chain_id=['COqcVduKRciTFGyFq6bFPw']) at 0x7f8a0fdcf520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:21.402938 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954976f-ecb7-4931-93af-77622be69594 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:21.403456 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954976f-ecb7-4931-93af-77622be69594 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:21.403923 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954976f-ecb7-4931-93af-77622be69594 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:21.466532 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 84/164] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:21.467949 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f20f0-930b-40d0-bf07-5ab3998ba3db None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:21.536772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954976f-ecb7-4931-93af-77622be69594 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:21.538717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954976f-ecb7-4931-93af-77622be69594 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:21.628633 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:21.677837 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f20f0-930b-40d0-bf07-5ab3998ba3db None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:21.718688 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 81/165] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:21.720083 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954976f-ecb7-4931-93af-77622be69594 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:21.731470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:21.751293 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c7a09-2a7b-4b5a-8762-a16f33dabad5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UzqtEMj4RaOt-5GWr0XXeA, audit_chain_id=['UzqtEMj4RaOt-5GWr0XXeA']) at 0x7f8a0fe2bfd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:21.752953 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c7a09-2a7b-4b5a-8762-a16f33dabad5 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:21.753697 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c7a09-2a7b-4b5a-8762-a16f33dabad5 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:21.754927 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c7a09-2a7b-4b5a-8762-a16f33dabad5 None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:21.757508 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c7a09-2a7b-4b5a-8762-a16f33dabad5 None admin] RBAC: Authorizing `identity:get_project(project_id=c312d273f41543edafc129654a960b7b)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:21.759402 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c7a09-2a7b-4b5a-8762-a16f33dabad5 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:21.765711 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 85/166] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:21 2022] GET /identity/v3/projects/c312d273f41543edafc129654a960b7b => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:21.766769 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c7a09-2a7b-4b5a-8762-a16f33dabad5 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:21.861336 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954976f-ecb7-4931-93af-77622be69594 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:21.903349 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57412c23-ee57-45ca-beda-91b84371718b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AeDXsY2CQn-9jaFJF13B9g, audit_chain_id=['AeDXsY2CQn-9jaFJF13B9g']) at 0x7f8a0fe22250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:21.904351 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57412c23-ee57-45ca-beda-91b84371718b None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:21.905462 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57412c23-ee57-45ca-beda-91b84371718b None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:21.905967 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57412c23-ee57-45ca-beda-91b84371718b None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:21.907028 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57412c23-ee57-45ca-beda-91b84371718b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:21.907572 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57412c23-ee57-45ca-beda-91b84371718b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:21.909250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57412c23-ee57-45ca-beda-91b84371718b None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:21.918594 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 82/167] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:21.919740 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57412c23-ee57-45ca-beda-91b84371718b None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:21.936618 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:21.971093 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c7a09-2a7b-4b5a-8762-a16f33dabad5 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:22.039362 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f03d50-8e17-4779-9044-bdb58f15a7c3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HOGQkAHPQY2y9SHP42LzvQ, audit_chain_id=['HOGQkAHPQY2y9SHP42LzvQ']) at 0x7f8a0fe32a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:22.042183 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03d50-8e17-4779-9044-bdb58f15a7c3 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:22.042804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03d50-8e17-4779-9044-bdb58f15a7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:22.048051 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03d50-8e17-4779-9044-bdb58f15a7c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:22.082716 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f03d50-8e17-4779-9044-bdb58f15a7c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:22.090443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-03f03d50-8e17-4779-9044-bdb58f15a7c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:22.090443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:22.090443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:22.090443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:22.090443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:22.090443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:22.090443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:22.090443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:22.090443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:22.090443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:22.090443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:22.090443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:22.090443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:22.090443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:22.090443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:22.090443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:22.091349 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:22.091349 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:22.091349 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:22.091349 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:22.091349 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:22.091349 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:22.091349 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:22.091349 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:22.091349 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:22.091349 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:22.091349 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:22.091349 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:22.091349 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:22.091349 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:22.091349 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:22.091349 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:22.092767 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:22.092767 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:22.092767 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:22.092767 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:22.092767 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:22.092767 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:22.092767 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:22.092767 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:22.092767 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:22.092767 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:22.092767 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:22.092767 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:47:22.092767 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 86/168] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:22.098737 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f03d50-8e17-4779-9044-bdb58f15a7c3 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:22.150862 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57412c23-ee57-45ca-beda-91b84371718b None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:22.218541 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fc733-b7b6-4fb7-87a1-c4a835fec1c8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=COqcVduKRciTFGyFq6bFPw, audit_chain_id=['COqcVduKRciTFGyFq6bFPw']) at 0x7f8a0fe47d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:22.219155 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fc733-b7b6-4fb7-87a1-c4a835fec1c8 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:22.219447 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fc733-b7b6-4fb7-87a1-c4a835fec1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:22.219731 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2fc733-b7b6-4fb7-87a1-c4a835fec1c8 None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:22.221098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fc733-b7b6-4fb7-87a1-c4a835fec1c8 None admin] RBAC: Authorizing `identity:get_project(project_id=c312d273f41543edafc129654a960b7b)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:22.222652 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2fc733-b7b6-4fb7-87a1-c4a835fec1c8 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:22.224555 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 83/169] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:21 2022] GET /identity/v3/projects/c312d273f41543edafc129654a960b7b => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:22.225403 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fc733-b7b6-4fb7-87a1-c4a835fec1c8 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:22.244782 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:22.369359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f03d50-8e17-4779-9044-bdb58f15a7c3 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:22.414158 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78e64a-4b89-4580-97a1-69386c0f689d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UzqtEMj4RaOt-5GWr0XXeA, audit_chain_id=['UzqtEMj4RaOt-5GWr0XXeA']) at 0x7f8a0fe2b6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:22.415241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78e64a-4b89-4580-97a1-69386c0f689d None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:22.415716 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78e64a-4b89-4580-97a1-69386c0f689d None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:22.416182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78e64a-4b89-4580-97a1-69386c0f689d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:22.417163 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78e64a-4b89-4580-97a1-69386c0f689d None admin] RBAC: Adding query filter params (role.id=e0342a5e42664f35948f522071411514, scope.project.id=c312d273f41543edafc129654a960b7b, user.id=e088deb3ffe740c48565d7c35c2e9bc9) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:22.417712 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78e64a-4b89-4580-97a1-69386c0f689d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:22.419366 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78e64a-4b89-4580-97a1-69386c0f689d None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:22.426583 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 87/170] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:47:22 2022] GET /identity/v3/role_assignments?user.id=e088deb3ffe740c48565d7c35c2e9bc9&scope.project.id=c312d273f41543edafc129654a960b7b&role.id=e0342a5e42664f35948f522071411514 => generated 608 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:22.427827 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78e64a-4b89-4580-97a1-69386c0f689d None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:22.440700 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:22.523669 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2fc733-b7b6-4fb7-87a1-c4a835fec1c8 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:22.570603 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78e64a-4b89-4580-97a1-69386c0f689d None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:22.592315 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:22.614956 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834b11d-b58b-439d-8911-879989c424ff None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HOGQkAHPQY2y9SHP42LzvQ, audit_chain_id=['HOGQkAHPQY2y9SHP42LzvQ']) at 0x7f8a0fdc23a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:22.615595 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834b11d-b58b-439d-8911-879989c424ff None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:22.615965 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834b11d-b58b-439d-8911-879989c424ff None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:22.616174 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834b11d-b58b-439d-8911-879989c424ff None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:22.616876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834b11d-b58b-439d-8911-879989c424ff None admin] RBAC: Adding query filter params (name=member) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:22.617184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834b11d-b58b-439d-8911-879989c424ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:22.618624 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834b11d-b58b-439d-8911-879989c424ff None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:22.631005 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03e8cd-7a70-47c9-8365-04d8a97fe817 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AeDXsY2CQn-9jaFJF13B9g, audit_chain_id=['AeDXsY2CQn-9jaFJF13B9g']) at 0x7f8a0fe46d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:22.631685 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03e8cd-7a70-47c9-8365-04d8a97fe817 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:22.631969 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03e8cd-7a70-47c9-8365-04d8a97fe817 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:22.632250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03e8cd-7a70-47c9-8365-04d8a97fe817 None admin] PATH_INFO: `/v3/users/21915d6d53c54080a8c4d15c72508181` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:22.633526 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03e8cd-7a70-47c9-8365-04d8a97fe817 None admin] RBAC: Authorizing `identity:get_user(user_id=21915d6d53c54080a8c4d15c72508181)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:22.635043 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03e8cd-7a70-47c9-8365-04d8a97fe817 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:22.636886 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 84/171] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:22 2022] GET /identity/v3/users/21915d6d53c54080a8c4d15c72508181 => generated 247 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:22.637488 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03e8cd-7a70-47c9-8365-04d8a97fe817 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:22.642826 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 88/172] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:22.643986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf64c18-f701-4ef1-893a-9629b7f2f72e None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:22.644278 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf64c18-f701-4ef1-893a-9629b7f2f72e None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:22.644557 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf64c18-f701-4ef1-893a-9629b7f2f72e None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:22.645846 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 89/173] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:22.646953 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d325a-6659-4729-a8b8-717b4bdfe979 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:22.647278 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d325a-6659-4729-a8b8-717b4bdfe979 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:22.647517 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d325a-6659-4729-a8b8-717b4bdfe979 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:22.648813 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 90/174] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:22.649611 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d325a-6659-4729-a8b8-717b4bdfe979 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:22.773669 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d325a-6659-4729-a8b8-717b4bdfe979 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:22.775917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03e8cd-7a70-47c9-8365-04d8a97fe817 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:22.807703 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650226c-3bab-46a3-baef-59f6cb2d7797 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AeDXsY2CQn-9jaFJF13B9g, audit_chain_id=['AeDXsY2CQn-9jaFJF13B9g']) at 0x7f8a0fdc2640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:22.808320 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650226c-3bab-46a3-baef-59f6cb2d7797 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:22.808598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650226c-3bab-46a3-baef-59f6cb2d7797 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:22.808867 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650226c-3bab-46a3-baef-59f6cb2d7797 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:22.810653 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105ee23-61e5-4711-8a22-ec27c46acaa9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=COqcVduKRciTFGyFq6bFPw, audit_chain_id=['COqcVduKRciTFGyFq6bFPw']) at 0x7f8a0fe427c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:22.812295 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105ee23-61e5-4711-8a22-ec27c46acaa9 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:22.812582 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105ee23-61e5-4711-8a22-ec27c46acaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:22.812863 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105ee23-61e5-4711-8a22-ec27c46acaa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:22.813682 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105ee23-61e5-4711-8a22-ec27c46acaa9 None admin] RBAC: Adding query filter params (role.id=c57f45d724fe45009701c9b2706d661c, scope.project.id=c312d273f41543edafc129654a960b7b, user.id=e088deb3ffe740c48565d7c35c2e9bc9) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:22.813996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105ee23-61e5-4711-8a22-ec27c46acaa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:22.815445 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105ee23-61e5-4711-8a22-ec27c46acaa9 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:22.821265 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 85/175] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:47:22 2022] GET /identity/v3/role_assignments?user.id=e088deb3ffe740c48565d7c35c2e9bc9&scope.project.id=c312d273f41543edafc129654a960b7b&role.id=c57f45d724fe45009701c9b2706d661c => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:22.822078 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105ee23-61e5-4711-8a22-ec27c46acaa9 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:22.852237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:22.863131 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:22.885352 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650226c-3bab-46a3-baef-59f6cb2d7797 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:22.886930 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650226c-3bab-46a3-baef-59f6cb2d7797 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:22.958732 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105ee23-61e5-4711-8a22-ec27c46acaa9 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:22.996111 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646471a5-c382-414f-89cb-ae5981c34cc3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HOGQkAHPQY2y9SHP42LzvQ, audit_chain_id=['HOGQkAHPQY2y9SHP42LzvQ']) at 0x7f8a0fe478e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:22.996784 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646471a5-c382-414f-89cb-ae5981c34cc3 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:22.997070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646471a5-c382-414f-89cb-ae5981c34cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:22.997354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646471a5-c382-414f-89cb-ae5981c34cc3 None admin] PATH_INFO: `/v3/users/e088deb3ffe740c48565d7c35c2e9bc9` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:22.999218 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646471a5-c382-414f-89cb-ae5981c34cc3 None admin] RBAC: Authorizing `identity:get_user(user_id=e088deb3ffe740c48565d7c35c2e9bc9)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:23.000734 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646471a5-c382-414f-89cb-ae5981c34cc3 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:23.002403 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 86/176] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:22 2022] GET /identity/v3/users/e088deb3ffe740c48565d7c35c2e9bc9 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:23.002922 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 91/177] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:23.003548 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028566d-f38b-4f67-80d4-d70194610351 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:23.003840 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028566d-f38b-4f67-80d4-d70194610351 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:23.004119 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028566d-f38b-4f67-80d4-d70194610351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:23.004274 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3096f-8e2a-4a5c-b4ad-a424a1d75911 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:23.004516 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3096f-8e2a-4a5c-b4ad-a424a1d75911 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:23.004798 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3096f-8e2a-4a5c-b4ad-a424a1d75911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:23.024750 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-0aa3096f-8e2a-4a5c-b4ad-a424a1d75911 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:23.025878 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-0aa3096f-8e2a-4a5c-b4ad-a424a1d75911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:23.028463 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-e028566d-f38b-4f67-80d4-d70194610351 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:23.029757 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-e028566d-f38b-4f67-80d4-d70194610351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:23.104028 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 87/178] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:23.105499 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 92/179] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:23.105634 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba01aa2-77b2-429f-ba2f-e9084884e035 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:23.105712 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba01aa2-77b2-429f-ba2f-e9084884e035 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:23.106007 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba01aa2-77b2-429f-ba2f-e9084884e035 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:23.107315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 88/180] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:23.108051 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba01aa2-77b2-429f-ba2f-e9084884e035 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:23.116184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7b14c-0ddc-4394-89a0-909b26bc3f2a None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:23.116727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7b14c-0ddc-4394-89a0-909b26bc3f2a None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:23.117200 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7b14c-0ddc-4394-89a0-909b26bc3f2a None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:23.118724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 93/181] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:23 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:23.119680 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7b14c-0ddc-4394-89a0-909b26bc3f2a None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:23.128956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:23.135385 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:23.216645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba01aa2-77b2-429f-ba2f-e9084884e035 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:23.225470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7b14c-0ddc-4394-89a0-909b26bc3f2a None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:23.251110 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a99ab2-d18b-429b-8484-367a315251a6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HOGQkAHPQY2y9SHP42LzvQ, audit_chain_id=['HOGQkAHPQY2y9SHP42LzvQ']) at 0x7f8a0fe64df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:23.251733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99ab2-d18b-429b-8484-367a315251a6 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:23.252017 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99ab2-d18b-429b-8484-367a315251a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:23.252298 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99ab2-d18b-429b-8484-367a315251a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:23.259576 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04592c-1e5f-4038-b8f9-28080384b1dc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AeDXsY2CQn-9jaFJF13B9g, audit_chain_id=['AeDXsY2CQn-9jaFJF13B9g']) at 0x7f8a0fdc8cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:23.260215 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04592c-1e5f-4038-b8f9-28080384b1dc None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:23.260498 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04592c-1e5f-4038-b8f9-28080384b1dc None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:23.260776 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04592c-1e5f-4038-b8f9-28080384b1dc None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:23.261956 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04592c-1e5f-4038-b8f9-28080384b1dc None admin] RBAC: Authorizing `identity:get_project(project_id=c312d273f41543edafc129654a960b7b)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:23.263408 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04592c-1e5f-4038-b8f9-28080384b1dc None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:23.265792 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 94/182] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:23 2022] GET /identity/v3/projects/c312d273f41543edafc129654a960b7b => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:23.270919 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc89eb-95ea-46e2-a9d6-377e97c563d7 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:23.271206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc89eb-95ea-46e2-a9d6-377e97c563d7 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:23.271483 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc89eb-95ea-46e2-a9d6-377e97c563d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:23.289415 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-35fc89eb-95ea-46e2-a9d6-377e97c563d7 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:23.290548 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-35fc89eb-95ea-46e2-a9d6-377e97c563d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:23.324576 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a99ab2-d18b-429b-8484-367a315251a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:23.326086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a99ab2-d18b-429b-8484-367a315251a6 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:23.337944 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:23.358239 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 95/183] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:23.359552 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac78bcb-7eaf-4f20-bc94-80b5abc8e2aa None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:23.359897 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac78bcb-7eaf-4f20-bc94-80b5abc8e2aa None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:23.360259 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac78bcb-7eaf-4f20-bc94-80b5abc8e2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:23.377367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-fac78bcb-7eaf-4f20-bc94-80b5abc8e2aa None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:23.378589 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-fac78bcb-7eaf-4f20-bc94-80b5abc8e2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:23.380927 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:23.438535 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 89/184] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:23.438535 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a99ab2-d18b-429b-8484-367a315251a6 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:23.447163 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 96/185] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:23.448013 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac78bcb-7eaf-4f20-bc94-80b5abc8e2aa None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:23.550126 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac78bcb-7eaf-4f20-bc94-80b5abc8e2aa None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:23.553140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a99ab2-d18b-429b-8484-367a315251a6 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:23.564225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:23.584696 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6af17e-c93a-4ca1-b328-eef3c7dad06f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=krUIWkhBTD-zp5gXhUazUQ, audit_chain_id=['krUIWkhBTD-zp5gXhUazUQ']) at 0x7f8a0fec9cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:23.585341 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6af17e-c93a-4ca1-b328-eef3c7dad06f None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:23.585653 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6af17e-c93a-4ca1-b328-eef3c7dad06f None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:23.585934 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6af17e-c93a-4ca1-b328-eef3c7dad06f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:23.588958 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2dd50-fa12-4a5e-956c-f602615caeab None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ENsYNO8GTgqpxvFGkBSziw, audit_chain_id=['ENsYNO8GTgqpxvFGkBSziw']) at 0x7f8a0fe66d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:23.589633 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2dd50-fa12-4a5e-956c-f602615caeab None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:23.589923 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2dd50-fa12-4a5e-956c-f602615caeab None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:23.590200 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2dd50-fa12-4a5e-956c-f602615caeab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:23.593349 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:23.597426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6af17e-c93a-4ca1-b328-eef3c7dad06f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:23.601447 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2dd50-fa12-4a5e-956c-f602615caeab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:23.602598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-ac6af17e-c93a-4ca1-b328-eef3c7dad06f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:47:23.602598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:23.602598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:23.602598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:23.602598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:23.602598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:23.602598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:23.602598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:23.602598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:23.602598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:23.602598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:23.602598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:23.602598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:23.602598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:23.602598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:23.602598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:23.603658 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:23.603658 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:23.603658 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:23.603658 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:23.603658 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:23.603658 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:23.603658 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:23.603658 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:23.603658 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:23.603658 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:23.603658 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:23.603658 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:23.603658 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:23.603658 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:23.603658 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:23.603658 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:23.604455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:23.604455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:23.604455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:23.604455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:23.604455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:23.604455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:23.604455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:23.604455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:23.604455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:23.604455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:23.604455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:47:23.604455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:47:23.604455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 97/186] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 22:47:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:23.605607 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6af17e-c93a-4ca1-b328-eef3c7dad06f None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:23.606421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-28f2dd50-fa12-4a5e-956c-f602615caeab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:47:23.606421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:23.606421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:23.606421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:23.606421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:23.606421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:23.606421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:23.606421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:23.606421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:23.606421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:23.606421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:23.606421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:23.606421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:23.606421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:23.606421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:23.606421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:23.607266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:23.607266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:23.607266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:23.607266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:23.607266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:23.607266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:23.607266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:23.607266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:23.607266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:23.607266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:23.607266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:23.607266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:23.607266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:23.607266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:23.607266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:23.607266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:23.610314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:23.610314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:23.610314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:23.610314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:23.610314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:23.610314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:23.610314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:23.610314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:23.610314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:23.610314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:23.610314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:47:23.610314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:23.610314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 90/187] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:23.610314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2dd50-fa12-4a5e-956c-f602615caeab None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:23.707341 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6af17e-c93a-4ca1-b328-eef3c7dad06f None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:23.708535 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2dd50-fa12-4a5e-956c-f602615caeab None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:23.742460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a872a52-ed15-4d05-9344-b0506e1cc13b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AeDXsY2CQn-9jaFJF13B9g, audit_chain_id=['AeDXsY2CQn-9jaFJF13B9g']) at 0x7f8a0fdd5310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:23.742689 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd170d-ba93-4af0-aec3-beb76734b7ba None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=euGUXeEATG6J5I0QLD4ong, audit_chain_id=['euGUXeEATG6J5I0QLD4ong']) at 0x7f8a0fdce670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:23.743079 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a872a52-ed15-4d05-9344-b0506e1cc13b None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:23.743203 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd170d-ba93-4af0-aec3-beb76734b7ba None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:23.743363 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a872a52-ed15-4d05-9344-b0506e1cc13b None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:23.743467 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd170d-ba93-4af0-aec3-beb76734b7ba None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:23.743640 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd170d-ba93-4af0-aec3-beb76734b7ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:23.743748 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a872a52-ed15-4d05-9344-b0506e1cc13b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:23.744428 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a872a52-ed15-4d05-9344-b0506e1cc13b None admin] RBAC: Adding query filter params (role.id=6ca03befbf3a456eae350bc7e583488f, scope.project.id=c312d273f41543edafc129654a960b7b, user.id=21915d6d53c54080a8c4d15c72508181) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:23.744740 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a872a52-ed15-4d05-9344-b0506e1cc13b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:23.746224 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a872a52-ed15-4d05-9344-b0506e1cc13b None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:23.752502 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 98/188] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:47:23 2022] GET /identity/v3/role_assignments?user.id=21915d6d53c54080a8c4d15c72508181&scope.project.id=c312d273f41543edafc129654a960b7b&role.id=6ca03befbf3a456eae350bc7e583488f => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:23.753298 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a872a52-ed15-4d05-9344-b0506e1cc13b None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:23.762248 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd170d-ba93-4af0-aec3-beb76734b7ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:23.769020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-adcd170d-ba93-4af0-aec3-beb76734b7ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:23.769020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:23.769020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:23.769020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:23.769020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:23.769020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:23.769020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:23.769020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:23.769020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:23.769020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:23.769020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:23.769020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:23.769020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:23.769020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:23.769020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:23.769020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:23.770046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:23.770046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:23.770046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:23.770046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:23.770046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:23.770046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:23.770046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:23.770046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:23.770046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:23.770046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:23.770046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:23.770046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:23.770046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:23.770046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:23.770046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:23.770046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:23.771064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:23.771064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:23.771064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:23.771064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:23.771064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:23.771064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:23.771064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:23.771064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:23.771064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:23.771064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:23.771064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:23.771064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:23.771064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 91/189] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:47:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:23.771910 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd170d-ba93-4af0-aec3-beb76734b7ba None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:23.807138 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:23.832508 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:23.881076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a872a52-ed15-4d05-9344-b0506e1cc13b None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:23.889498 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd170d-ba93-4af0-aec3-beb76734b7ba None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:23.921469 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d12765-fabb-427c-8de5-e3e801dd1a01 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HOGQkAHPQY2y9SHP42LzvQ, audit_chain_id=['HOGQkAHPQY2y9SHP42LzvQ']) at 0x7f8a0fe32880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:23.922254 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d12765-fabb-427c-8de5-e3e801dd1a01 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:23.922581 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d12765-fabb-427c-8de5-e3e801dd1a01 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:23.922810 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d12765-fabb-427c-8de5-e3e801dd1a01 None admin] PATH_INFO: `/v3/projects/89b71af52ea14593953aa38fdefe4fa1` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:23.923985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d12765-fabb-427c-8de5-e3e801dd1a01 None admin] RBAC: Authorizing `identity:get_project(project_id=89b71af52ea14593953aa38fdefe4fa1)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:23.925425 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d12765-fabb-427c-8de5-e3e801dd1a01 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:23.926502 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9877a90-d2d2-4e95-98d6-2a9b0b99ab68 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=adV0CvsiQYKgVYIDgrN_dg, audit_chain_id=['adV0CvsiQYKgVYIDgrN_dg']) at 0x7f8a0fde50d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:23.927130 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 99/190] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:23 2022] GET /identity/v3/projects/89b71af52ea14593953aa38fdefe4fa1 => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:23.927232 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9877a90-d2d2-4e95-98d6-2a9b0b99ab68 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:23.927456 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9877a90-d2d2-4e95-98d6-2a9b0b99ab68 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:23.927790 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9877a90-d2d2-4e95-98d6-2a9b0b99ab68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:23.929012 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9877a90-d2d2-4e95-98d6-2a9b0b99ab68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:23.930004 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d12765-fabb-427c-8de5-e3e801dd1a01 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:23.930567 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9877a90-d2d2-4e95-98d6-2a9b0b99ab68 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:23.932294 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 92/191] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:47:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:23.937343 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9877a90-d2d2-4e95-98d6-2a9b0b99ab68 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:24.046397 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:24.049322 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d12765-fabb-427c-8de5-e3e801dd1a01 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:24.050341 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9877a90-d2d2-4e95-98d6-2a9b0b99ab68 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:24.078549 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:24.084772 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa4921-cbdb-4040-a248-615eeef067fd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=krUIWkhBTD-zp5gXhUazUQ, audit_chain_id=['krUIWkhBTD-zp5gXhUazUQ']) at 0x7f8a0fe27b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:24.085395 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa4921-cbdb-4040-a248-615eeef067fd None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:24.085704 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa4921-cbdb-4040-a248-615eeef067fd None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:24.085985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa4921-cbdb-4040-a248-615eeef067fd None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:24.086551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61343d87-be17-417e-b78a-95668478575e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ENsYNO8GTgqpxvFGkBSziw, audit_chain_id=['ENsYNO8GTgqpxvFGkBSziw']) at 0x7f8a0fdc0700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:24.086671 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa4921-cbdb-4040-a248-615eeef067fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:24.086982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa4921-cbdb-4040-a248-615eeef067fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:24.087172 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61343d87-be17-417e-b78a-95668478575e None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:24.087457 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61343d87-be17-417e-b78a-95668478575e None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:24.087734 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61343d87-be17-417e-b78a-95668478575e None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:24.088344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa4921-cbdb-4040-a248-615eeef067fd None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:24.088434 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61343d87-be17-417e-b78a-95668478575e None admin] RBAC: Adding query filter params (name=reader) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:24.088735 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61343d87-be17-417e-b78a-95668478575e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:24.090172 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61343d87-be17-417e-b78a-95668478575e None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:24.098122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 100/192] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:24.098707 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa4921-cbdb-4040-a248-615eeef067fd None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:24.099084 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 93/193] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:24.099888 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61343d87-be17-417e-b78a-95668478575e None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:24.199625 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa4921-cbdb-4040-a248-615eeef067fd None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:24.202765 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61343d87-be17-417e-b78a-95668478575e None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:24.231833 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3747920-b8d8-4364-ad64-e18f83bdb2de None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=euGUXeEATG6J5I0QLD4ong, audit_chain_id=['euGUXeEATG6J5I0QLD4ong']) at 0x7f8a0fe14910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:24.232445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3747920-b8d8-4364-ad64-e18f83bdb2de None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:24.233276 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3747920-b8d8-4364-ad64-e18f83bdb2de None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:24.233547 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3747920-b8d8-4364-ad64-e18f83bdb2de None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:24.234281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3747920-b8d8-4364-ad64-e18f83bdb2de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:24.234583 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3747920-b8d8-4364-ad64-e18f83bdb2de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:24.235953 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3747920-b8d8-4364-ad64-e18f83bdb2de None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:24.236040 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df687b-0fc7-4a59-a6c3-77043f663702 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HOGQkAHPQY2y9SHP42LzvQ, audit_chain_id=['HOGQkAHPQY2y9SHP42LzvQ']) at 0x7f8a0fe20c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:24.236632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df687b-0fc7-4a59-a6c3-77043f663702 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:24.236917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df687b-0fc7-4a59-a6c3-77043f663702 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:24.237197 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df687b-0fc7-4a59-a6c3-77043f663702 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:24.238021 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df687b-0fc7-4a59-a6c3-77043f663702 None admin] RBAC: Adding query filter params (role.id=c57f45d724fe45009701c9b2706d661c, scope.project.id=89b71af52ea14593953aa38fdefe4fa1, user.id=e088deb3ffe740c48565d7c35c2e9bc9) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:24.238334 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df687b-0fc7-4a59-a6c3-77043f663702 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:24.239783 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df687b-0fc7-4a59-a6c3-77043f663702 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:24.243691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 101/194] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:47:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:24.246825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3747920-b8d8-4364-ad64-e18f83bdb2de None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:24.250741 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 94/195] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:47:24 2022] GET /identity/v3/role_assignments?user.id=e088deb3ffe740c48565d7c35c2e9bc9&scope.project.id=89b71af52ea14593953aa38fdefe4fa1&role.id=c57f45d724fe45009701c9b2706d661c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:24.252704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df687b-0fc7-4a59-a6c3-77043f663702 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:24.284820 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:24.328886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:24.380483 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3747920-b8d8-4364-ad64-e18f83bdb2de None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:24.381895 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df687b-0fc7-4a59-a6c3-77043f663702 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:24.418466 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dc432-ece2-4533-905f-7f1f3ca93f45 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=adV0CvsiQYKgVYIDgrN_dg, audit_chain_id=['adV0CvsiQYKgVYIDgrN_dg']) at 0x7f8a0fe71d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:24.419263 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dc432-ece2-4533-905f-7f1f3ca93f45 None admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:24.419517 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dc432-ece2-4533-905f-7f1f3ca93f45 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:24.419792 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dc432-ece2-4533-905f-7f1f3ca93f45 None admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:24.419974 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee001de8-0f27-491c-93d0-8198aa60a3de None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=krUIWkhBTD-zp5gXhUazUQ, audit_chain_id=['krUIWkhBTD-zp5gXhUazUQ']) at 0x7f8a0fe46070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:24.420572 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894dc432-ece2-4533-905f-7f1f3ca93f45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:24.420747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee001de8-0f27-491c-93d0-8198aa60a3de None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:24.421033 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee001de8-0f27-491c-93d0-8198aa60a3de None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:24.421312 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee001de8-0f27-491c-93d0-8198aa60a3de None admin] PATH_INFO: `/v3/users/19f5836b0a7c48eb9b7f8198538b2d2f` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:24.422261 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894dc432-ece2-4533-905f-7f1f3ca93f45 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:24.437922 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee001de8-0f27-491c-93d0-8198aa60a3de None admin] RBAC: Authorizing `identity:get_user(user_id=19f5836b0a7c48eb9b7f8198538b2d2f)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:24.440530 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee001de8-0f27-491c-93d0-8198aa60a3de None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:24.443724 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 95/196] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:24 2022] GET /identity/v3/users/19f5836b0a7c48eb9b7f8198538b2d2f => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:24.443724 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee001de8-0f27-491c-93d0-8198aa60a3de None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:24.452245 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 102/197] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 22:47:24 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:47:24.453211 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dc432-ece2-4533-905f-7f1f3ca93f45 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:24.568630 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:24.593596 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee001de8-0f27-491c-93d0-8198aa60a3de None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:24.597736 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dc432-ece2-4533-905f-7f1f3ca93f45 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:24.610120 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:24.636461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4f869-460f-41f3-a7f0-fc13bdca8dc0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ENsYNO8GTgqpxvFGkBSziw, audit_chain_id=['ENsYNO8GTgqpxvFGkBSziw']) at 0x7f8a0fe555b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:24.637012 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c6cbf-88c6-44d8-96fc-0a55ba9fb1bc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=euGUXeEATG6J5I0QLD4ong, audit_chain_id=['euGUXeEATG6J5I0QLD4ong']) at 0x7f8a0fe1e1c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:24.637653 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4f869-460f-41f3-a7f0-fc13bdca8dc0 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:24.637778 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c6cbf-88c6-44d8-96fc-0a55ba9fb1bc None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:24.637973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c6cbf-88c6-44d8-96fc-0a55ba9fb1bc None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:24.638067 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4f869-460f-41f3-a7f0-fc13bdca8dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:24.638247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c6cbf-88c6-44d8-96fc-0a55ba9fb1bc None admin] PATH_INFO: `/v3/users/19f5836b0a7c48eb9b7f8198538b2d2f` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:24.638341 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed4f869-460f-41f3-a7f0-fc13bdca8dc0 None admin] PATH_INFO: `/v3/users/5874935317854b289ddc864c60faeac0` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:24.639508 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c6cbf-88c6-44d8-96fc-0a55ba9fb1bc None admin] RBAC: Authorizing `identity:get_user(user_id=19f5836b0a7c48eb9b7f8198538b2d2f)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:24.640988 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c6cbf-88c6-44d8-96fc-0a55ba9fb1bc None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:24.641370 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4f869-460f-41f3-a7f0-fc13bdca8dc0 None admin] RBAC: Authorizing `identity:get_user(user_id=5874935317854b289ddc864c60faeac0)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:24.643167 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 103/198] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:24 2022] GET /identity/v3/users/19f5836b0a7c48eb9b7f8198538b2d2f => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:24.643279 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed4f869-460f-41f3-a7f0-fc13bdca8dc0 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:24.644426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c6cbf-88c6-44d8-96fc-0a55ba9fb1bc None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:24.644834 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 96/199] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:24 2022] GET /identity/v3/users/5874935317854b289ddc864c60faeac0 => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:24.650930 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4f869-460f-41f3-a7f0-fc13bdca8dc0 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:24.772717 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c6cbf-88c6-44d8-96fc-0a55ba9fb1bc None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:24.782848 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed4f869-460f-41f3-a7f0-fc13bdca8dc0 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:24.816940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bad8ea-5194-42da-8aac-3fc346cc1333 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=krUIWkhBTD-zp5gXhUazUQ, audit_chain_id=['krUIWkhBTD-zp5gXhUazUQ']) at 0x7f8a0fe93a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:24.817569 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bad8ea-5194-42da-8aac-3fc346cc1333 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:24.817876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bad8ea-5194-42da-8aac-3fc346cc1333 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:24.818151 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bad8ea-5194-42da-8aac-3fc346cc1333 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:24.823806 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f69256-a72d-437e-a722-846f3d1bf50b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=euGUXeEATG6J5I0QLD4ong, audit_chain_id=['euGUXeEATG6J5I0QLD4ong']) at 0x7f8a0fe66ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:24.824720 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f69256-a72d-437e-a722-846f3d1bf50b None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:24.825189 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f69256-a72d-437e-a722-846f3d1bf50b None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:24.825663 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f69256-a72d-437e-a722-846f3d1bf50b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:24.847244 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:24.874828 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:24.903764 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bad8ea-5194-42da-8aac-3fc346cc1333 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:24.906429 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bad8ea-5194-42da-8aac-3fc346cc1333 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:24.915361 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f69256-a72d-437e-a722-846f3d1bf50b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:24.917067 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f69256-a72d-437e-a722-846f3d1bf50b None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:25.017335 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 104/200] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:25.018632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bad8ea-5194-42da-8aac-3fc346cc1333 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:25.033105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 97/201] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:25.034070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f69256-a72d-437e-a722-846f3d1bf50b None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:25.088303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:25.102938 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:25.126383 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bad8ea-5194-42da-8aac-3fc346cc1333 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:25.146415 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f69256-a72d-437e-a722-846f3d1bf50b None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:25.162397 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399c3d0-a0c2-4220-bcff-c9f7c5ccfefe None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ENsYNO8GTgqpxvFGkBSziw, audit_chain_id=['ENsYNO8GTgqpxvFGkBSziw']) at 0x7f8a0fe26f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:25.163339 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399c3d0-a0c2-4220-bcff-c9f7c5ccfefe None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:25.163836 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399c3d0-a0c2-4220-bcff-c9f7c5ccfefe None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:25.164323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399c3d0-a0c2-4220-bcff-c9f7c5ccfefe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:25.181180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98001f8a-bfb8-4b5c-ab06-f94fadd517c6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=krUIWkhBTD-zp5gXhUazUQ, audit_chain_id=['krUIWkhBTD-zp5gXhUazUQ']) at 0x7f8a0fe55d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:25.181878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98001f8a-bfb8-4b5c-ab06-f94fadd517c6 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:25.182160 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98001f8a-bfb8-4b5c-ab06-f94fadd517c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:25.182434 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98001f8a-bfb8-4b5c-ab06-f94fadd517c6 None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:25.183717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98001f8a-bfb8-4b5c-ab06-f94fadd517c6 None admin] RBAC: Authorizing `identity:get_project(project_id=fa144b85a37b4dd191df360058c783d1)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:25.185351 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98001f8a-bfb8-4b5c-ab06-f94fadd517c6 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:25.187939 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 98/202] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:25 2022] GET /identity/v3/projects/fa144b85a37b4dd191df360058c783d1 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:25.189158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98001f8a-bfb8-4b5c-ab06-f94fadd517c6 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:25.236641 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399c3d0-a0c2-4220-bcff-c9f7c5ccfefe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:25.238468 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399c3d0-a0c2-4220-bcff-c9f7c5ccfefe None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:25.296373 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98001f8a-bfb8-4b5c-ab06-f94fadd517c6 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:25.316547 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:25.318635 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:25.342843 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90038d-5a6e-4329-b85d-ce97df864e24 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=euGUXeEATG6J5I0QLD4ong, audit_chain_id=['euGUXeEATG6J5I0QLD4ong']) at 0x7f8a0fe46d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:25.343733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90038d-5a6e-4329-b85d-ce97df864e24 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:25.344162 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90038d-5a6e-4329-b85d-ce97df864e24 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:25.344579 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90038d-5a6e-4329-b85d-ce97df864e24 None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:25.345250 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 105/203] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:25.346106 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90038d-5a6e-4329-b85d-ce97df864e24 None admin] RBAC: Authorizing `identity:get_project(project_id=fa144b85a37b4dd191df360058c783d1)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:25.346362 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399c3d0-a0c2-4220-bcff-c9f7c5ccfefe None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:25.347973 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90038d-5a6e-4329-b85d-ce97df864e24 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:25.351150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 99/204] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:25 2022] GET /identity/v3/projects/fa144b85a37b4dd191df360058c783d1 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:25.352169 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90038d-5a6e-4329-b85d-ce97df864e24 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:25.456759 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399c3d0-a0c2-4220-bcff-c9f7c5ccfefe None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:25.499117 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90038d-5a6e-4329-b85d-ce97df864e24 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:25.500677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506155d-7fa1-4524-9c30-1c117a1ff6f9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=krUIWkhBTD-zp5gXhUazUQ, audit_chain_id=['krUIWkhBTD-zp5gXhUazUQ']) at 0x7f8a0fdc2a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:25.501377 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506155d-7fa1-4524-9c30-1c117a1ff6f9 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:25.501798 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506155d-7fa1-4524-9c30-1c117a1ff6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:25.502799 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506155d-7fa1-4524-9c30-1c117a1ff6f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:25.503046 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506155d-7fa1-4524-9c30-1c117a1ff6f9 None admin] RBAC: Adding query filter params (role.id=6ca03befbf3a456eae350bc7e583488f, scope.project.id=fa144b85a37b4dd191df360058c783d1, user.id=19f5836b0a7c48eb9b7f8198538b2d2f) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:25.503451 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506155d-7fa1-4524-9c30-1c117a1ff6f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:25.504980 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506155d-7fa1-4524-9c30-1c117a1ff6f9 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:25.510747 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 106/205] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:47:25 2022] GET /identity/v3/role_assignments?user.id=19f5836b0a7c48eb9b7f8198538b2d2f&scope.project.id=fa144b85a37b4dd191df360058c783d1&role.id=6ca03befbf3a456eae350bc7e583488f => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:25.511892 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506155d-7fa1-4524-9c30-1c117a1ff6f9 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:25.541339 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e33b2-c2d1-4cd0-85d0-8abf8c7fcce7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ENsYNO8GTgqpxvFGkBSziw, audit_chain_id=['ENsYNO8GTgqpxvFGkBSziw']) at 0x7f8a0fde4310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:25.542304 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e33b2-c2d1-4cd0-85d0-8abf8c7fcce7 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:25.542818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e33b2-c2d1-4cd0-85d0-8abf8c7fcce7 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:25.543290 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e33b2-c2d1-4cd0-85d0-8abf8c7fcce7 None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:25.544679 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e33b2-c2d1-4cd0-85d0-8abf8c7fcce7 None admin] RBAC: Authorizing `identity:get_project(project_id=c312d273f41543edafc129654a960b7b)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:25.547343 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e33b2-c2d1-4cd0-85d0-8abf8c7fcce7 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:25.549428 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 100/206] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:25 2022] GET /identity/v3/projects/c312d273f41543edafc129654a960b7b => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:25.558404 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e33b2-c2d1-4cd0-85d0-8abf8c7fcce7 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:25.573632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:25.672416 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:25.694717 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506155d-7fa1-4524-9c30-1c117a1ff6f9 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:25.755086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e33b2-c2d1-4cd0-85d0-8abf8c7fcce7 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:25.777048 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb1ce0-c310-439d-8968-5ef041a67d79 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=euGUXeEATG6J5I0QLD4ong, audit_chain_id=['euGUXeEATG6J5I0QLD4ong']) at 0x7f8a0fe2bf10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:25.778473 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb1ce0-c310-439d-8968-5ef041a67d79 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:25.778473 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb1ce0-c310-439d-8968-5ef041a67d79 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:25.778643 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb1ce0-c310-439d-8968-5ef041a67d79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:25.779387 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb1ce0-c310-439d-8968-5ef041a67d79 None admin] RBAC: Adding query filter params (role.id=e0342a5e42664f35948f522071411514, scope.project.id=fa144b85a37b4dd191df360058c783d1, user.id=19f5836b0a7c48eb9b7f8198538b2d2f) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:25.779697 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb1ce0-c310-439d-8968-5ef041a67d79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:25.786353 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb1ce0-c310-439d-8968-5ef041a67d79 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:25.803610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 107/207] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:47:25 2022] GET /identity/v3/role_assignments?user.id=19f5836b0a7c48eb9b7f8198538b2d2f&scope.project.id=fa144b85a37b4dd191df360058c783d1&role.id=e0342a5e42664f35948f522071411514 => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:25.816980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458153fe-7af7-4e61-954f-429e9a2a943a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ENsYNO8GTgqpxvFGkBSziw, audit_chain_id=['ENsYNO8GTgqpxvFGkBSziw']) at 0x7f8a0fdc6af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:25.818058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458153fe-7af7-4e61-954f-429e9a2a943a None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:25.818577 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458153fe-7af7-4e61-954f-429e9a2a943a None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:25.819055 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458153fe-7af7-4e61-954f-429e9a2a943a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:25.820092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458153fe-7af7-4e61-954f-429e9a2a943a None admin] RBAC: Adding query filter params (role.id=862b3fa9d6834bd3b14681fc489500a7, scope.project.id=c312d273f41543edafc129654a960b7b, user.id=5874935317854b289ddc864c60faeac0) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:25.820654 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458153fe-7af7-4e61-954f-429e9a2a943a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:25.822452 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458153fe-7af7-4e61-954f-429e9a2a943a None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:25.836136 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 101/208] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:47:25 2022] GET /identity/v3/role_assignments?user.id=5874935317854b289ddc864c60faeac0&scope.project.id=c312d273f41543edafc129654a960b7b&role.id=862b3fa9d6834bd3b14681fc489500a7 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:27.005194 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264277c-0dc5-4769-be55-c2ba4160d49f None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:27.006239 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264277c-0dc5-4769-be55-c2ba4160d49f None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:27.006735 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264277c-0dc5-4769-be55-c2ba4160d49f None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:27.008769 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f68ac-61bd-4f64-b275-3b4d49bc656c None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:27.009149 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f68ac-61bd-4f64-b275-3b4d49bc656c None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:27.009307 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f68ac-61bd-4f64-b275-3b4d49bc656c None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:27.009507 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 108/209] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:27.010824 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 102/210] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:27.016169 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c72e03-44f5-44a7-99a7-d30f9a0d7a44 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:27.016458 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c72e03-44f5-44a7-99a7-d30f9a0d7a44 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:27.017002 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c72e03-44f5-44a7-99a7-d30f9a0d7a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:27.017238 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1274c4-6cc3-4f31-93d1-d691f1b450ad None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:27.017760 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1274c4-6cc3-4f31-93d1-d691f1b450ad None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:27.018231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1274c4-6cc3-4f31-93d1-d691f1b450ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:27.035525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-b0c72e03-44f5-44a7-99a7-d30f9a0d7a44 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:27.036714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-b0c72e03-44f5-44a7-99a7-d30f9a0d7a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:27.039330 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-6a1274c4-6cc3-4f31-93d1-d691f1b450ad None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:27.041392 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-6a1274c4-6cc3-4f31-93d1-d691f1b450ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:27.114113 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 103/211] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:47:27.125530 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 109/212] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:47:27.145557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c72e03-44f5-44a7-99a7-d30f9a0d7a44 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:27.151173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1274c4-6cc3-4f31-93d1-d691f1b450ad None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:27.198586 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:27.210591 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:27.282035 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c72e03-44f5-44a7-99a7-d30f9a0d7a44 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:27.298463 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1274c4-6cc3-4f31-93d1-d691f1b450ad None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:27.328170 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5de0f-b4df-4738-8004-d0762469a4f0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CJn3-CbkRcGKBrEDP8fFog, audit_chain_id=['CJn3-CbkRcGKBrEDP8fFog']) at 0x7f8a0fe469a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:27.329730 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5de0f-b4df-4738-8004-d0762469a4f0 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:27.330086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5de0f-b4df-4738-8004-d0762469a4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:27.330687 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5de0f-b4df-4738-8004-d0762469a4f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:27.332173 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5de0f-b4df-4738-8004-d0762469a4f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:27.334348 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5de0f-b4df-4738-8004-d0762469a4f0 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:27.336961 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 104/213] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:47:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:27.340640 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b3f87-7d53-453e-aa0c-4b8e8b88f942 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ghDHkDVmRue_SFRCX89KnA, audit_chain_id=['ghDHkDVmRue_SFRCX89KnA']) at 0x7f8a1415f3a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:27.341355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b3f87-7d53-453e-aa0c-4b8e8b88f942 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:27.342477 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b3f87-7d53-453e-aa0c-4b8e8b88f942 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:27.342760 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b3f87-7d53-453e-aa0c-4b8e8b88f942 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:27.343672 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5de0f-b4df-4738-8004-d0762469a4f0 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:27.355594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b3f87-7d53-453e-aa0c-4b8e8b88f942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:27.363470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-b64b3f87-7d53-453e-aa0c-4b8e8b88f942 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:27.363470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:27.363470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:27.363470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:27.363470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:27.363470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:27.363470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:27.363470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:27.363470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:27.363470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:27.363470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:27.363470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:27.363470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:27.363470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:27.363470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:27.363470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:27.364555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:27.364555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:27.364555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:27.364555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:27.364555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:27.364555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:27.364555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:27.364555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:27.364555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:27.364555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:27.364555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:27.364555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:27.364555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:27.364555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:27.364555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:27.364555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:27.366351 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:27.366351 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:27.366351 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:27.366351 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:27.366351 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:27.366351 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:27.366351 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:27.366351 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:27.366351 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:27.366351 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:27.366351 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:27.366351 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:47:27.366351 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 110/214] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:47:27.370714 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b3f87-7d53-453e-aa0c-4b8e8b88f942 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:27.472999 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5de0f-b4df-4738-8004-d0762469a4f0 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:27.486364 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:27.501237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:27.509465 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b3f87-7d53-453e-aa0c-4b8e8b88f942 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:27.561972 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbd159-694f-40cf-869f-587fd68b1235 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CJn3-CbkRcGKBrEDP8fFog, audit_chain_id=['CJn3-CbkRcGKBrEDP8fFog']) at 0x7f8a0fe1c5b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:27.562498 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbd159-694f-40cf-869f-587fd68b1235 None admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:27.562781 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbd159-694f-40cf-869f-587fd68b1235 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:27.563055 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbd159-694f-40cf-869f-587fd68b1235 None admin] PATH_INFO: `/v3/users` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:27.563853 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbd159-694f-40cf-869f-587fd68b1235 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:27.574481 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbd159-694f-40cf-869f-587fd68b1235 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:27.579596 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e992a8a-f8bc-4172-b1c8-5768ff119267 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ghDHkDVmRue_SFRCX89KnA, audit_chain_id=['ghDHkDVmRue_SFRCX89KnA']) at 0x7f8a0fde0e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:27.582303 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e992a8a-f8bc-4172-b1c8-5768ff119267 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:27.585760 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e992a8a-f8bc-4172-b1c8-5768ff119267 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:27.586692 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e992a8a-f8bc-4172-b1c8-5768ff119267 None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:27.587789 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e992a8a-f8bc-4172-b1c8-5768ff119267 None admin] RBAC: Adding query filter params (name=member) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:27.590453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e992a8a-f8bc-4172-b1c8-5768ff119267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:27.593458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e992a8a-f8bc-4172-b1c8-5768ff119267 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:27.613603 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 105/215] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 22:47:27 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:47:27.617251 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 111/216] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:27.626981 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbd159-694f-40cf-869f-587fd68b1235 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:27.835227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbd159-694f-40cf-869f-587fd68b1235 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:27.874603 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82913e0e-0be3-41fd-97f1-80f920f1bc45 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ghDHkDVmRue_SFRCX89KnA, audit_chain_id=['ghDHkDVmRue_SFRCX89KnA']) at 0x7f8a0fdcf370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:27.875274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82913e0e-0be3-41fd-97f1-80f920f1bc45 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:27.875564 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82913e0e-0be3-41fd-97f1-80f920f1bc45 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:27.875843 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82913e0e-0be3-41fd-97f1-80f920f1bc45 None admin] PATH_INFO: `/v3/users/66f750e9ae444c50babf0f33b2192fea` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:27.891282 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82913e0e-0be3-41fd-97f1-80f920f1bc45 None admin] RBAC: Authorizing `identity:get_user(user_id=66f750e9ae444c50babf0f33b2192fea)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:27.893376 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82913e0e-0be3-41fd-97f1-80f920f1bc45 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:27.897426 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 106/217] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:27 2022] GET /identity/v3/users/66f750e9ae444c50babf0f33b2192fea => generated 297 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:27.903379 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e992a8a-f8bc-4172-b1c8-5768ff119267 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:27.912765 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bae64a-f39e-4f0f-afc7-1ab7efecb700 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:27.913159 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bae64a-f39e-4f0f-afc7-1ab7efecb700 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:27.913442 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bae64a-f39e-4f0f-afc7-1ab7efecb700 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:27.916135 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 107/218] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:27.922996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43ad5c-9106-40e0-971b-3e85e3d41a56 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:27.923829 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43ad5c-9106-40e0-971b-3e85e3d41a56 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:27.924301 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43ad5c-9106-40e0-971b-3e85e3d41a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:27.951250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-eb43ad5c-9106-40e0-971b-3e85e3d41a56 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:27.952819 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-eb43ad5c-9106-40e0-971b-3e85e3d41a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:27.984024 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:28.062689 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 108/219] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:28.090092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43ad5c-9106-40e0-971b-3e85e3d41a56 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:28.099207 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e992a8a-f8bc-4172-b1c8-5768ff119267 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:28.156283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd614932-5c27-4c62-8dd4-a3345eb1111e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ghDHkDVmRue_SFRCX89KnA, audit_chain_id=['ghDHkDVmRue_SFRCX89KnA']) at 0x7f8a0fe273a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:28.157309 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd614932-5c27-4c62-8dd4-a3345eb1111e None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:28.157827 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd614932-5c27-4c62-8dd4-a3345eb1111e None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:28.158293 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd614932-5c27-4c62-8dd4-a3345eb1111e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:28.191826 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:28.239923 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43ad5c-9106-40e0-971b-3e85e3d41a56 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:28.240368 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd614932-5c27-4c62-8dd4-a3345eb1111e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:28.242394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd614932-5c27-4c62-8dd4-a3345eb1111e None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:28.285075 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cc62a-72b6-4d1a-8636-76f73dfa96fa None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=RGEHXhFZT6qZnX8519c1zQ, audit_chain_id=['RGEHXhFZT6qZnX8519c1zQ']) at 0x7f8a0fe5b8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:28.285775 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cc62a-72b6-4d1a-8636-76f73dfa96fa None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:28.286064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cc62a-72b6-4d1a-8636-76f73dfa96fa None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:28.286346 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cc62a-72b6-4d1a-8636-76f73dfa96fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:28.299423 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680cc62a-72b6-4d1a-8636-76f73dfa96fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:28.306152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-680cc62a-72b6-4d1a-8636-76f73dfa96fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:47:28.306152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:28.306152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:28.306152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:28.306152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:28.306152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:28.306152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:28.306152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:28.306152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:28.306152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:28.306152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:28.306152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:28.306152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:28.306152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:28.306152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:28.306152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:28.307101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:28.307101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:28.307101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:28.307101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:28.307101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:28.307101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:28.307101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:28.307101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:28.307101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:28.307101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:28.307101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:28.307101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:28.307101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:28.307101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:28.307101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:28.307101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:28.307885 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:28.307885 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:28.307885 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:28.307885 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:28.307885 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:28.307885 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:28.307885 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:28.307885 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:28.307885 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:28.307885 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:28.307885 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:47:28.307885 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:28.307885 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 109/220] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 22:47:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:28.314414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cc62a-72b6-4d1a-8636-76f73dfa96fa None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:28.353058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:28.392679 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 112/221] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:28.395040 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd614932-5c27-4c62-8dd4-a3345eb1111e None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:28.478939 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cc62a-72b6-4d1a-8636-76f73dfa96fa None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:28.522376 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c887054-3831-428c-b241-bd9dd4472321 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=RGEHXhFZT6qZnX8519c1zQ, audit_chain_id=['RGEHXhFZT6qZnX8519c1zQ']) at 0x7f8a0fd852e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:28.523272 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c887054-3831-428c-b241-bd9dd4472321 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:28.523549 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c887054-3831-428c-b241-bd9dd4472321 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:28.523819 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c887054-3831-428c-b241-bd9dd4472321 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:28.524364 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:28.524538 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c887054-3831-428c-b241-bd9dd4472321 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:28.524846 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c887054-3831-428c-b241-bd9dd4472321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:28.527381 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c887054-3831-428c-b241-bd9dd4472321 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:28.539622 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 110/222] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:28.546852 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ce429-e8b7-4ada-ae53-df481ee1e647 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:28.547156 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ce429-e8b7-4ada-ae53-df481ee1e647 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:28.547437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ce429-e8b7-4ada-ae53-df481ee1e647 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:28.550352 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 111/223] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:28.552050 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ce429-e8b7-4ada-ae53-df481ee1e647 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:28.572017 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd614932-5c27-4c62-8dd4-a3345eb1111e None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:28.610137 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdaf83-997c-4209-875f-8d6703932a95 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ghDHkDVmRue_SFRCX89KnA, audit_chain_id=['ghDHkDVmRue_SFRCX89KnA']) at 0x7f8a0feeddf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:28.610833 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdaf83-997c-4209-875f-8d6703932a95 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:28.611122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdaf83-997c-4209-875f-8d6703932a95 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:28.611404 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdaf83-997c-4209-875f-8d6703932a95 None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:28.612633 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdaf83-997c-4209-875f-8d6703932a95 None admin] RBAC: Authorizing `identity:get_project(project_id=fa144b85a37b4dd191df360058c783d1)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:28.614469 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdaf83-997c-4209-875f-8d6703932a95 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:28.616512 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 113/224] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:28 2022] GET /identity/v3/projects/fa144b85a37b4dd191df360058c783d1 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:28.622460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e078e-5f0b-4ae5-b242-cd8e1d26da3b None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:28.622749 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e078e-5f0b-4ae5-b242-cd8e1d26da3b None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:28.623718 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e078e-5f0b-4ae5-b242-cd8e1d26da3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:28.642395 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-316e078e-5f0b-4ae5-b242-cd8e1d26da3b None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:28.643591 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-316e078e-5f0b-4ae5-b242-cd8e1d26da3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:28.670280 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:28.697282 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ce429-e8b7-4ada-ae53-df481ee1e647 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:28.722969 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 114/225] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:28.723845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e078e-5f0b-4ae5-b242-cd8e1d26da3b None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:28.756807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a442a9e-15e6-445c-a1ac-f5711a7ba053 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=RGEHXhFZT6qZnX8519c1zQ, audit_chain_id=['RGEHXhFZT6qZnX8519c1zQ']) at 0x7f8a0fdcfd00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:28.757465 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a442a9e-15e6-445c-a1ac-f5711a7ba053 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:28.757774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a442a9e-15e6-445c-a1ac-f5711a7ba053 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:28.758053 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a442a9e-15e6-445c-a1ac-f5711a7ba053 None admin] PATH_INFO: `/v3/users/19f5836b0a7c48eb9b7f8198538b2d2f` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:28.760242 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a442a9e-15e6-445c-a1ac-f5711a7ba053 None admin] RBAC: Authorizing `identity:get_user(user_id=19f5836b0a7c48eb9b7f8198538b2d2f)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:28.763356 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a442a9e-15e6-445c-a1ac-f5711a7ba053 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:28.763495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 112/226] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:28 2022] GET /identity/v3/users/19f5836b0a7c48eb9b7f8198538b2d2f => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:28.764230 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a442a9e-15e6-445c-a1ac-f5711a7ba053 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:28.810795 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:28.866242 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e078e-5f0b-4ae5-b242-cd8e1d26da3b None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:28.881688 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a442a9e-15e6-445c-a1ac-f5711a7ba053 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:28.901845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a7dd4-abf3-49c3-bc22-66a7e5d2044f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ghDHkDVmRue_SFRCX89KnA, audit_chain_id=['ghDHkDVmRue_SFRCX89KnA']) at 0x7f8a0fe0ef40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:28.902474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a7dd4-abf3-49c3-bc22-66a7e5d2044f None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:28.902754 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a7dd4-abf3-49c3-bc22-66a7e5d2044f None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:28.903030 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a7dd4-abf3-49c3-bc22-66a7e5d2044f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:28.903829 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a7dd4-abf3-49c3-bc22-66a7e5d2044f None admin] RBAC: Adding query filter params (role.id=c57f45d724fe45009701c9b2706d661c, scope.project.id=fa144b85a37b4dd191df360058c783d1, user.id=66f750e9ae444c50babf0f33b2192fea) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:28.904679 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a7dd4-abf3-49c3-bc22-66a7e5d2044f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:28.906250 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a7dd4-abf3-49c3-bc22-66a7e5d2044f None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:28.912031 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 115/227] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:47:28 2022] GET /identity/v3/role_assignments?user.id=66f750e9ae444c50babf0f33b2192fea&scope.project.id=fa144b85a37b4dd191df360058c783d1&role.id=c57f45d724fe45009701c9b2706d661c => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:28.912817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a7dd4-abf3-49c3-bc22-66a7e5d2044f None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:28.923871 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520c7b5-c7be-4719-ac05-74966ee6a0a6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FJblWsD9S8GqWVf50u6vWg, audit_chain_id=['FJblWsD9S8GqWVf50u6vWg']) at 0x7f8a0fe209a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:28.924886 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520c7b5-c7be-4719-ac05-74966ee6a0a6 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:28.925372 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520c7b5-c7be-4719-ac05-74966ee6a0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:28.925893 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520c7b5-c7be-4719-ac05-74966ee6a0a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:28.937835 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520c7b5-c7be-4719-ac05-74966ee6a0a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:28.943692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-8520c7b5-c7be-4719-ac05-74966ee6a0a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:28.943692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:28.943692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:28.943692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:28.943692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:28.943692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:28.943692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:28.943692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:28.943692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:28.943692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:28.943692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:28.943692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:28.943692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:28.943692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:28.943692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:28.943692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:28.944562 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:28.944562 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:28.944562 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:28.944562 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:28.944562 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:28.944562 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:28.944562 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:28.944562 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:28.944562 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:28.944562 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:28.944562 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:28.944562 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:28.944562 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:28.944562 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:28.944562 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:28.944562 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:28.945359 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:28.945359 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:28.945359 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:28.945359 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:28.945359 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:28.945359 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:28.945359 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:28.945359 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:28.945359 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:28.945359 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:28.945359 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:28.945359 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:28.948218 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 113/228] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:47:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:28.954619 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520c7b5-c7be-4719-ac05-74966ee6a0a6 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:28.969986 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:29.073194 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520c7b5-c7be-4719-ac05-74966ee6a0a6 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:29.115016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736a90b-bf5b-475d-8a49-38368faf3298 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FJblWsD9S8GqWVf50u6vWg, audit_chain_id=['FJblWsD9S8GqWVf50u6vWg']) at 0x7f8a0fdf04f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:29.116548 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736a90b-bf5b-475d-8a49-38368faf3298 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:29.117039 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736a90b-bf5b-475d-8a49-38368faf3298 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:29.117521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736a90b-bf5b-475d-8a49-38368faf3298 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:29.118723 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736a90b-bf5b-475d-8a49-38368faf3298 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:29.119253 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736a90b-bf5b-475d-8a49-38368faf3298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:29.120902 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d736a90b-bf5b-475d-8a49-38368faf3298 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:29.132782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 114/229] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:47:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:29.139244 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736a90b-bf5b-475d-8a49-38368faf3298 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:29.192024 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a7dd4-abf3-49c3-bc22-66a7e5d2044f None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:29.230118 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:29.255688 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a465fb-c273-4728-923a-d335fe1d6ac6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=RGEHXhFZT6qZnX8519c1zQ, audit_chain_id=['RGEHXhFZT6qZnX8519c1zQ']) at 0x7f8a0fe1fc70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:29.256352 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a465fb-c273-4728-923a-d335fe1d6ac6 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:29.256658 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a465fb-c273-4728-923a-d335fe1d6ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:29.256940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a465fb-c273-4728-923a-d335fe1d6ac6 None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:29.259197 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a465fb-c273-4728-923a-d335fe1d6ac6 None admin] RBAC: Authorizing `identity:get_project(project_id=fa144b85a37b4dd191df360058c783d1)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:29.260659 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a465fb-c273-4728-923a-d335fe1d6ac6 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:29.264273 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 116/230] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:28 2022] GET /identity/v3/projects/fa144b85a37b4dd191df360058c783d1 => generated 302 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:29.266164 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:29.272371 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a465fb-c273-4728-923a-d335fe1d6ac6 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:29.303615 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736a90b-bf5b-475d-8a49-38368faf3298 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:29.360455 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a9cfa-cbd4-4079-8e61-a77aeb1b669f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FJblWsD9S8GqWVf50u6vWg, audit_chain_id=['FJblWsD9S8GqWVf50u6vWg']) at 0x7f8a0fe557c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:29.361533 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a9cfa-cbd4-4079-8e61-a77aeb1b669f None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:29.362025 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a9cfa-cbd4-4079-8e61-a77aeb1b669f None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:29.362520 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a9cfa-cbd4-4079-8e61-a77aeb1b669f None admin] PATH_INFO: `/v3/users/19f5836b0a7c48eb9b7f8198538b2d2f` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:29.366419 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a9cfa-cbd4-4079-8e61-a77aeb1b669f None admin] RBAC: Authorizing `identity:get_user(user_id=19f5836b0a7c48eb9b7f8198538b2d2f)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:29.367970 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a9cfa-cbd4-4079-8e61-a77aeb1b669f None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:29.369749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 115/231] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:29 2022] GET /identity/v3/users/19f5836b0a7c48eb9b7f8198538b2d2f => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:29.377479 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a9cfa-cbd4-4079-8e61-a77aeb1b669f None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:29.415208 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a465fb-c273-4728-923a-d335fe1d6ac6 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:29.451014 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1171b8-bbd7-4e13-ad6f-d2aea9c736b7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=RGEHXhFZT6qZnX8519c1zQ, audit_chain_id=['RGEHXhFZT6qZnX8519c1zQ']) at 0x7f8a0fe1ec40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:29.451699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1171b8-bbd7-4e13-ad6f-d2aea9c736b7 None admin] REQUEST_METHOD: `PUT` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:29.451986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1171b8-bbd7-4e13-ad6f-d2aea9c736b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:29.452269 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1171b8-bbd7-4e13-ad6f-d2aea9c736b7 None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1/users/19f5836b0a7c48eb9b7f8198538b2d2f/roles/6ca03befbf3a456eae350bc7e583488f` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:29.454293 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1171b8-bbd7-4e13-ad6f-d2aea9c736b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa144b85a37b4dd191df360058c783d1, user_id=19f5836b0a7c48eb9b7f8198538b2d2f, role_id=6ca03befbf3a456eae350bc7e583488f)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:29.455770 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1171b8-bbd7-4e13-ad6f-d2aea9c736b7 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:29.479821 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 117/232] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 22:47:29 2022] PUT /identity/v3/projects/fa144b85a37b4dd191df360058c783d1/users/19f5836b0a7c48eb9b7f8198538b2d2f/roles/6ca03befbf3a456eae350bc7e583488f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:47:29.561613 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a9cfa-cbd4-4079-8e61-a77aeb1b669f None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:29.615281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a56eb-cb20-44c1-8338-9bdee5e1c1c1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FJblWsD9S8GqWVf50u6vWg, audit_chain_id=['FJblWsD9S8GqWVf50u6vWg']) at 0x7f8a0fe477c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:29.615967 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a56eb-cb20-44c1-8338-9bdee5e1c1c1 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:29.616246 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a56eb-cb20-44c1-8338-9bdee5e1c1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:29.616608 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a56eb-cb20-44c1-8338-9bdee5e1c1c1 None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:29.617928 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a56eb-cb20-44c1-8338-9bdee5e1c1c1 None admin] RBAC: Authorizing `identity:get_project(project_id=fa144b85a37b4dd191df360058c783d1)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:29.619496 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a56eb-cb20-44c1-8338-9bdee5e1c1c1 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:29.621610 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 116/233] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:29 2022] GET /identity/v3/projects/fa144b85a37b4dd191df360058c783d1 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:29.627544 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1171b8-bbd7-4e13-ad6f-d2aea9c736b7 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:29.721974 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:29.772042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1171b8-bbd7-4e13-ad6f-d2aea9c736b7 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:29.812075 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4372bd1-1acb-4ff6-98b7-1b8eaca3bd36 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FJblWsD9S8GqWVf50u6vWg, audit_chain_id=['FJblWsD9S8GqWVf50u6vWg']) at 0x7f8a151adfa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:29.812770 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4372bd1-1acb-4ff6-98b7-1b8eaca3bd36 None admin] REQUEST_METHOD: `PUT` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:29.813055 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4372bd1-1acb-4ff6-98b7-1b8eaca3bd36 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:29.813335 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4372bd1-1acb-4ff6-98b7-1b8eaca3bd36 None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1/users/19f5836b0a7c48eb9b7f8198538b2d2f/roles/e0342a5e42664f35948f522071411514` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:29.815600 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4372bd1-1acb-4ff6-98b7-1b8eaca3bd36 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa144b85a37b4dd191df360058c783d1, user_id=19f5836b0a7c48eb9b7f8198538b2d2f, role_id=e0342a5e42664f35948f522071411514)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:29.817067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4372bd1-1acb-4ff6-98b7-1b8eaca3bd36 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:29.834360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 118/234] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 22:47:29 2022] PUT /identity/v3/projects/fa144b85a37b4dd191df360058c783d1/users/19f5836b0a7c48eb9b7f8198538b2d2f/roles/e0342a5e42664f35948f522071411514 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:47:30.514642 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7afa03-03b1-4799-a628-cd4a34bcb305 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:30.515245 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7afa03-03b1-4799-a628-cd4a34bcb305 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:30.515354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7afa03-03b1-4799-a628-cd4a34bcb305 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:30.517000 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 117/235] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:30.526041 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258ea67-8080-402c-afb5-ca2db4ae6338 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:30.526538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258ea67-8080-402c-afb5-ca2db4ae6338 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:30.526687 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258ea67-8080-402c-afb5-ca2db4ae6338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:30.550934 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-a258ea67-8080-402c-afb5-ca2db4ae6338 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:30.552125 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-a258ea67-8080-402c-afb5-ca2db4ae6338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:30.645571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 119/236] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:30.665444 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9fa86-980b-4a4b-9d38-a1f148f7c7aa None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:30.665761 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9fa86-980b-4a4b-9d38-a1f148f7c7aa None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:30.666045 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9fa86-980b-4a4b-9d38-a1f148f7c7aa None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:30.667548 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 118/237] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:30.673224 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f092a-b87c-4971-8bcb-52ca7d6b3124 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:30.673518 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f092a-b87c-4971-8bcb-52ca7d6b3124 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:30.673833 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f092a-b87c-4971-8bcb-52ca7d6b3124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:30.684356 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9fa86-980b-4a4b-9d38-a1f148f7c7aa None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:30.703448 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:30.710290 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-692f092a-b87c-4971-8bcb-52ca7d6b3124 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:30.711766 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-692f092a-b87c-4971-8bcb-52ca7d6b3124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:30.757377 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:30.794442 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 120/238] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:30.842866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f092a-b87c-4971-8bcb-52ca7d6b3124 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:30.882991 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9fa86-980b-4a4b-9d38-a1f148f7c7aa None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:30.938068 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773f387-a397-4c4a-94ce-c60fea6a0703 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=aPVMaS1OTsadHmMKrtqoZg, audit_chain_id=['aPVMaS1OTsadHmMKrtqoZg']) at 0x7f8a0fde5640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:30.939742 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773f387-a397-4c4a-94ce-c60fea6a0703 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:30.940373 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773f387-a397-4c4a-94ce-c60fea6a0703 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:30.942618 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773f387-a397-4c4a-94ce-c60fea6a0703 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:30.962776 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773f387-a397-4c4a-94ce-c60fea6a0703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:30.973089 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-1773f387-a397-4c4a-94ce-c60fea6a0703 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:47:30.973089 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:30.973089 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:30.973089 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:30.973089 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:30.973089 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:30.973089 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:30.973089 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:30.973089 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:30.973089 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:30.973089 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:30.973089 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:30.973089 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:30.973089 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:30.973089 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:30.973089 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:30.974202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:30.974202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:30.974202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:30.974202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:30.974202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:30.974202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:30.974202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:30.974202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:30.974202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:30.974202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:30.974202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:30.974202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:30.974202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:30.974202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:30.974202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:30.974202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:30.975180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:30.975180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:30.975180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:30.975180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:30.975180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:30.975180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:30.975180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:30.975180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:30.975180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:30.975180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:30.975180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:47:30.975180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:30.981170 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 119/239] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:30.988409 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773f387-a397-4c4a-94ce-c60fea6a0703 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:31.035833 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f092a-b87c-4971-8bcb-52ca7d6b3124 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:31.085327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:31.111291 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec2600-dd16-46a0-aea7-66e9a3ba0ab3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Y_haIaEFSJy92B2SvyLOaQ, audit_chain_id=['Y_haIaEFSJy92B2SvyLOaQ']) at 0x7f8a0fe87ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:31.111949 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec2600-dd16-46a0-aea7-66e9a3ba0ab3 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:31.112226 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec2600-dd16-46a0-aea7-66e9a3ba0ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:31.112497 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec2600-dd16-46a0-aea7-66e9a3ba0ab3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:31.114386 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec2600-dd16-46a0-aea7-66e9a3ba0ab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:31.115827 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec2600-dd16-46a0-aea7-66e9a3ba0ab3 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:31.117656 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 121/240] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:47:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:31.124830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec2600-dd16-46a0-aea7-66e9a3ba0ab3 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:31.151678 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773f387-a397-4c4a-94ce-c60fea6a0703 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:31.189997 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:31.193068 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa2ec5-2ae7-49e9-9504-d3eda0f0ecc7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=aPVMaS1OTsadHmMKrtqoZg, audit_chain_id=['aPVMaS1OTsadHmMKrtqoZg']) at 0x7f8a0fe47250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:31.193896 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa2ec5-2ae7-49e9-9504-d3eda0f0ecc7 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:31.194365 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa2ec5-2ae7-49e9-9504-d3eda0f0ecc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:31.194964 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa2ec5-2ae7-49e9-9504-d3eda0f0ecc7 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:31.195854 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa2ec5-2ae7-49e9-9504-d3eda0f0ecc7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:31.196367 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa2ec5-2ae7-49e9-9504-d3eda0f0ecc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:31.198601 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa2ec5-2ae7-49e9-9504-d3eda0f0ecc7 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:31.209215 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 120/241] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:31.222568 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa2ec5-2ae7-49e9-9504-d3eda0f0ecc7 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:31.276242 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec2600-dd16-46a0-aea7-66e9a3ba0ab3 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:31.313086 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e636865-581c-4181-a1d6-bb4e1b82b8b1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Y_haIaEFSJy92B2SvyLOaQ, audit_chain_id=['Y_haIaEFSJy92B2SvyLOaQ']) at 0x7f8a0fe25bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:31.314016 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e636865-581c-4181-a1d6-bb4e1b82b8b1 None admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:31.314471 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e636865-581c-4181-a1d6-bb4e1b82b8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:31.314908 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e636865-581c-4181-a1d6-bb4e1b82b8b1 None admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:31.315800 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e636865-581c-4181-a1d6-bb4e1b82b8b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:31.317384 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e636865-581c-4181-a1d6-bb4e1b82b8b1 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:31.347793 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 122/242] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 22:47:31 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:47:31.423738 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa2ec5-2ae7-49e9-9504-d3eda0f0ecc7 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:31.483167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:31.490750 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1ab41-6a2e-4430-accf-004f09007015 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=aPVMaS1OTsadHmMKrtqoZg, audit_chain_id=['aPVMaS1OTsadHmMKrtqoZg']) at 0x7f8a0fdf09a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:31.491416 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1ab41-6a2e-4430-accf-004f09007015 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:31.491742 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1ab41-6a2e-4430-accf-004f09007015 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:31.492027 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1ab41-6a2e-4430-accf-004f09007015 None admin] PATH_INFO: `/v3/users/78c270a1d38c4e16984fd4c6afb48739` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:31.517412 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1ab41-6a2e-4430-accf-004f09007015 None admin] RBAC: Authorizing `identity:get_user(user_id=78c270a1d38c4e16984fd4c6afb48739)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:31.518932 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1ab41-6a2e-4430-accf-004f09007015 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:31.520829 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 121/243] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:31 2022] GET /identity/v3/users/78c270a1d38c4e16984fd4c6afb48739 => generated 297 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:31.527081 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e636865-581c-4181-a1d6-bb4e1b82b8b1 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:31.618518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7af16-21d5-495a-aad2-ffd6922ac5f1 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:31.618718 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7af16-21d5-495a-aad2-ffd6922ac5f1 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:31.618973 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7af16-21d5-495a-aad2-ffd6922ac5f1 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:31.620326 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 122/244] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:31.635046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a0005-d9de-458a-a5e3-e123a735b9f5 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:31.635328 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a0005-d9de-458a-a5e3-e123a735b9f5 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:31.635608 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a0005-d9de-458a-a5e3-e123a735b9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:31.665753 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-ff2a0005-d9de-458a-a5e3-e123a735b9f5 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:31.667358 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-ff2a0005-d9de-458a-a5e3-e123a735b9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:31.683861 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:31.696856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e636865-581c-4181-a1d6-bb4e1b82b8b1 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:31.747898 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eebd7-07cb-4a1e-ab27-5b1692659da5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=aPVMaS1OTsadHmMKrtqoZg, audit_chain_id=['aPVMaS1OTsadHmMKrtqoZg']) at 0x7f8a0fdc46a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:31.748677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eebd7-07cb-4a1e-ab27-5b1692659da5 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:31.749257 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eebd7-07cb-4a1e-ab27-5b1692659da5 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:31.749731 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eebd7-07cb-4a1e-ab27-5b1692659da5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:31.775536 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 123/245] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:47:31.811641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a0005-d9de-458a-a5e3-e123a735b9f5 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:31.831712 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35eebd7-07cb-4a1e-ab27-5b1692659da5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:31.833258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35eebd7-07cb-4a1e-ab27-5b1692659da5 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:31.924362 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a0005-d9de-458a-a5e3-e123a735b9f5 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:31.931437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:31.943294 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 123/246] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:31.945885 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:31.949808 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eebd7-07cb-4a1e-ab27-5b1692659da5 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:31.966886 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e040e3-2633-45c1-bcba-e0fdbeb3f0fe None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=VcVhRDNUR3-u9Q_FnzD_Sg, audit_chain_id=['VcVhRDNUR3-u9Q_FnzD_Sg']) at 0x7f8a0fe47190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:31.968143 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e040e3-2633-45c1-bcba-e0fdbeb3f0fe None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:31.968572 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e040e3-2633-45c1-bcba-e0fdbeb3f0fe None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:31.969113 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e040e3-2633-45c1-bcba-e0fdbeb3f0fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:31.982906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e040e3-2633-45c1-bcba-e0fdbeb3f0fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:31.988945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-49e040e3-2633-45c1-bcba-e0fdbeb3f0fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:31.988945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:31.988945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:31.988945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:31.988945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:31.988945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:31.988945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:31.988945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:31.988945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:31.988945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:31.988945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:31.988945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:31.988945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:31.988945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:31.988945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:31.988945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:31.990158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:31.990158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:31.990158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:31.990158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:31.990158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:31.990158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:31.990158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:31.990158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:31.990158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:31.990158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:31.990158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:31.990158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:31.990158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:31.990158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:31.990158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:31.990158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:31.991145 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:31.991145 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:31.991145 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:31.991145 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:31.991145 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:31.991145 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:31.991145 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:31.991145 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:31.991145 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:31.991145 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:31.991145 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:31.991145 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:31.994345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 124/247] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:32.001851 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e040e3-2633-45c1-bcba-e0fdbeb3f0fe None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:32.077901 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eebd7-07cb-4a1e-ab27-5b1692659da5 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:32.122189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7d28b-ea50-498e-9596-341710d2b2a5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=aPVMaS1OTsadHmMKrtqoZg, audit_chain_id=['aPVMaS1OTsadHmMKrtqoZg']) at 0x7f8a0fe94670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:32.123448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7d28b-ea50-498e-9596-341710d2b2a5 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:32.123958 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7d28b-ea50-498e-9596-341710d2b2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:32.124435 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7d28b-ea50-498e-9596-341710d2b2a5 None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:32.125930 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7d28b-ea50-498e-9596-341710d2b2a5 None admin] RBAC: Authorizing `identity:get_project(project_id=fa144b85a37b4dd191df360058c783d1)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:32.127810 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7d28b-ea50-498e-9596-341710d2b2a5 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:32.129816 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e040e3-2633-45c1-bcba-e0fdbeb3f0fe None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:32.130274 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 124/248] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:31 2022] GET /identity/v3/projects/fa144b85a37b4dd191df360058c783d1 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:32.136235 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7d28b-ea50-498e-9596-341710d2b2a5 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:32.171821 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9748582-d426-4392-a649-55437d72eb8f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=VcVhRDNUR3-u9Q_FnzD_Sg, audit_chain_id=['VcVhRDNUR3-u9Q_FnzD_Sg']) at 0x7f8a0fdce610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:32.172731 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9748582-d426-4392-a649-55437d72eb8f None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:32.173020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9748582-d426-4392-a649-55437d72eb8f None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:32.173302 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9748582-d426-4392-a649-55437d72eb8f None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:32.174072 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9748582-d426-4392-a649-55437d72eb8f None admin] RBAC: Adding query filter params (name=member) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:32.174445 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9748582-d426-4392-a649-55437d72eb8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:32.176285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9748582-d426-4392-a649-55437d72eb8f None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:32.189999 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 125/249] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:32.196167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9748582-d426-4392-a649-55437d72eb8f None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:32.218510 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:32.277624 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:32.277835 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7d28b-ea50-498e-9596-341710d2b2a5 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:32.322097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9fff4-b893-4389-b857-d0a0b80b8374 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=aPVMaS1OTsadHmMKrtqoZg, audit_chain_id=['aPVMaS1OTsadHmMKrtqoZg']) at 0x7f8a0fe38520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:32.322737 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9fff4-b893-4389-b857-d0a0b80b8374 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:32.323018 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9fff4-b893-4389-b857-d0a0b80b8374 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:32.323289 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9fff4-b893-4389-b857-d0a0b80b8374 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:32.324360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9fff4-b893-4389-b857-d0a0b80b8374 None admin] RBAC: Adding query filter params (role.id=862b3fa9d6834bd3b14681fc489500a7, scope.project.id=fa144b85a37b4dd191df360058c783d1, user.id=78c270a1d38c4e16984fd4c6afb48739) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:32.324728 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9fff4-b893-4389-b857-d0a0b80b8374 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:32.327004 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9fff4-b893-4389-b857-d0a0b80b8374 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:32.335532 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 125/250] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:47:32 2022] GET /identity/v3/role_assignments?user.id=78c270a1d38c4e16984fd4c6afb48739&scope.project.id=fa144b85a37b4dd191df360058c783d1&role.id=862b3fa9d6834bd3b14681fc489500a7 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:32.411856 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9748582-d426-4392-a649-55437d72eb8f None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:32.463937 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a442b2-7d4c-42bf-afe0-c99f0f719421 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:32.464222 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a442b2-7d4c-42bf-afe0-c99f0f719421 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:32.464421 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a442b2-7d4c-42bf-afe0-c99f0f719421 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:32.466425 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 126/251] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:47:32.479898 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a3517-818a-4aae-a8a8-97343fd25789 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=VcVhRDNUR3-u9Q_FnzD_Sg, audit_chain_id=['VcVhRDNUR3-u9Q_FnzD_Sg']) at 0x7f8a0fe66ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:32.480230 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665e16d-c405-429e-9b93-6db8363f1eb6 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:32.480518 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665e16d-c405-429e-9b93-6db8363f1eb6 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:32.480620 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a3517-818a-4aae-a8a8-97343fd25789 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:32.480785 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665e16d-c405-429e-9b93-6db8363f1eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:32.480876 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a3517-818a-4aae-a8a8-97343fd25789 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:32.481093 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a3517-818a-4aae-a8a8-97343fd25789 None admin] PATH_INFO: `/v3/users/66f750e9ae444c50babf0f33b2192fea` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:32.483653 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a3517-818a-4aae-a8a8-97343fd25789 None admin] RBAC: Authorizing `identity:get_user(user_id=66f750e9ae444c50babf0f33b2192fea)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:32.485508 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a3517-818a-4aae-a8a8-97343fd25789 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:32.487531 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 126/252] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:32 2022] GET /identity/v3/users/66f750e9ae444c50babf0f33b2192fea => generated 297 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:32.493086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a3517-818a-4aae-a8a8-97343fd25789 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:32.517504 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-2665e16d-c405-429e-9b93-6db8363f1eb6 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:32.519156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-2665e16d-c405-429e-9b93-6db8363f1eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:32.659898 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 127/253] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:32.687753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665e16d-c405-429e-9b93-6db8363f1eb6 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:32.714694 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a3517-818a-4aae-a8a8-97343fd25789 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:32.730128 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:32.782340 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787e949-0a73-4876-8de8-61439ca1db63 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=VcVhRDNUR3-u9Q_FnzD_Sg, audit_chain_id=['VcVhRDNUR3-u9Q_FnzD_Sg']) at 0x7f8a0fdc14f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:32.783346 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787e949-0a73-4876-8de8-61439ca1db63 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:32.783803 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787e949-0a73-4876-8de8-61439ca1db63 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:32.784273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787e949-0a73-4876-8de8-61439ca1db63 None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:32.787237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787e949-0a73-4876-8de8-61439ca1db63 None admin] RBAC: Authorizing `identity:get_project(project_id=fa144b85a37b4dd191df360058c783d1)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:32.789127 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787e949-0a73-4876-8de8-61439ca1db63 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:32.791126 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 127/254] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:32 2022] GET /identity/v3/projects/fa144b85a37b4dd191df360058c783d1 => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:32.797682 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787e949-0a73-4876-8de8-61439ca1db63 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:32.823275 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:32.959876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665e16d-c405-429e-9b93-6db8363f1eb6 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:32.971565 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787e949-0a73-4876-8de8-61439ca1db63 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:33.042336 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2015a-b684-4a4b-be2e-9e97bc47dc4d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=VcVhRDNUR3-u9Q_FnzD_Sg, audit_chain_id=['VcVhRDNUR3-u9Q_FnzD_Sg']) at 0x7f8a0fe25460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:33.043322 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2015a-b684-4a4b-be2e-9e97bc47dc4d None admin] REQUEST_METHOD: `PUT` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:33.043874 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2015a-b684-4a4b-be2e-9e97bc47dc4d None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:33.044939 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2015a-b684-4a4b-be2e-9e97bc47dc4d None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1/users/66f750e9ae444c50babf0f33b2192fea/roles/c57f45d724fe45009701c9b2706d661c` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:33.049768 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2015a-b684-4a4b-be2e-9e97bc47dc4d None admin] RBAC: Authorizing `identity:create_grant(project_id=fa144b85a37b4dd191df360058c783d1, user_id=66f750e9ae444c50babf0f33b2192fea, role_id=c57f45d724fe45009701c9b2706d661c)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:33.051296 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb715c0-d2d9-43bd-bba6-aac270464fbd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ndkiq5UYQkmlwLE2BbZ9LA, audit_chain_id=['Ndkiq5UYQkmlwLE2BbZ9LA']) at 0x7f8a0fe074f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:33.051873 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2015a-b684-4a4b-be2e-9e97bc47dc4d None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:33.052095 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb715c0-d2d9-43bd-bba6-aac270464fbd None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:33.052449 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb715c0-d2d9-43bd-bba6-aac270464fbd None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:33.052795 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb715c0-d2d9-43bd-bba6-aac270464fbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:33.073655 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 128/255] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 22:47:32 2022] PUT /identity/v3/projects/fa144b85a37b4dd191df360058c783d1/users/66f750e9ae444c50babf0f33b2192fea/roles/c57f45d724fe45009701c9b2706d661c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:47:33.077030 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb715c0-d2d9-43bd-bba6-aac270464fbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:33.086838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-abb715c0-d2d9-43bd-bba6-aac270464fbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:47:33.086838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:33.086838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:33.086838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:33.086838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:33.086838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:33.086838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:33.086838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:33.086838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:33.086838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:33.086838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:33.086838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:33.086838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:33.086838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:33.086838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:33.086838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:33.087973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:33.087973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:33.087973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:33.087973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:33.087973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:33.087973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:33.087973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:33.087973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:33.087973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:33.087973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:33.087973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:33.087973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:33.087973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:33.087973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:33.087973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:33.087973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:33.088954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:33.088954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:33.088954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:33.088954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:33.088954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:33.088954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:33.088954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:33.088954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:33.088954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:33.088954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:33.088954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:47:33.088954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:47:33.091025 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 128/256] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 22:47:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:47:33.097615 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2015a-b684-4a4b-be2e-9e97bc47dc4d None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:33.155048 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:33.156785 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8cb34-3adc-450a-abde-7af706028cdf None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:33.157222 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8cb34-3adc-450a-abde-7af706028cdf None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:33.157714 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8cb34-3adc-450a-abde-7af706028cdf None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:33.159306 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 129/257] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:33.166042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7103e91-42a2-4081-8ddd-62f1f39c0f44 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:33.166539 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7103e91-42a2-4081-8ddd-62f1f39c0f44 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:33.166983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7103e91-42a2-4081-8ddd-62f1f39c0f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:33.200411 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-e7103e91-42a2-4081-8ddd-62f1f39c0f44 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:33.203787 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-e7103e91-42a2-4081-8ddd-62f1f39c0f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:33.308780 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2015a-b684-4a4b-be2e-9e97bc47dc4d None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:33.373065 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 130/258] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:33.378347 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc4641-d813-4bdd-9da3-42a5d136926a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ndkiq5UYQkmlwLE2BbZ9LA, audit_chain_id=['Ndkiq5UYQkmlwLE2BbZ9LA']) at 0x7f8a0fdc4ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:33.379247 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc4641-d813-4bdd-9da3-42a5d136926a None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:33.379723 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc4641-d813-4bdd-9da3-42a5d136926a None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:33.380191 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc4641-d813-4bdd-9da3-42a5d136926a None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:33.381157 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc4641-d813-4bdd-9da3-42a5d136926a None admin] RBAC: Adding query filter params (name=admin) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:33.381694 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc4641-d813-4bdd-9da3-42a5d136926a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:33.383363 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc4641-d813-4bdd-9da3-42a5d136926a None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:33.393772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 129/259] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:33.399586 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7103e91-42a2-4081-8ddd-62f1f39c0f44 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:33.409859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc4641-d813-4bdd-9da3-42a5d136926a None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:33.539394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:33.548904 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:33.554390 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc4641-d813-4bdd-9da3-42a5d136926a None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:33.612245 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd341f-5c4a-45e4-af3f-48ef1ebc4998 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=a9dorbVNTD-ZzwUZFjPivw, audit_chain_id=['a9dorbVNTD-ZzwUZFjPivw']) at 0x7f8a0fe472b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:33.612821 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd341f-5c4a-45e4-af3f-48ef1ebc4998 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:33.613106 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd341f-5c4a-45e4-af3f-48ef1ebc4998 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:33.613386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd341f-5c4a-45e4-af3f-48ef1ebc4998 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:33.635196 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd341f-5c4a-45e4-af3f-48ef1ebc4998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:33.763465 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7103e91-42a2-4081-8ddd-62f1f39c0f44 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:33.806147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-41dd341f-5c4a-45e4-af3f-48ef1ebc4998 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:33.806147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:33.806147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:33.806147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:33.806147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:33.806147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:33.806147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:33.806147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:33.806147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:33.806147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:33.806147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:33.806147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:33.806147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:33.806147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:33.806147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:33.806147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:33.807413 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:33.807413 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:33.807413 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:33.807413 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:33.807413 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:33.807413 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:33.807413 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:33.807413 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:33.807413 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:33.807413 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:33.807413 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:33.807413 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:33.807413 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:33.807413 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:33.807413 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:33.807413 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:33.808270 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:33.808270 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:33.808270 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:33.808270 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:33.808270 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:33.808270 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:33.808270 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:33.808270 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:33.808270 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:33.808270 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:33.808270 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:33.808270 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:33.813327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 130/260] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:47:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:33.814513 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd341f-5c4a-45e4-af3f-48ef1ebc4998 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:33.859973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2757b-daa9-4c82-8bc9-c0ac3e16694d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ndkiq5UYQkmlwLE2BbZ9LA, audit_chain_id=['Ndkiq5UYQkmlwLE2BbZ9LA']) at 0x7f8a0fe318e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:33.860635 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2757b-daa9-4c82-8bc9-c0ac3e16694d None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:33.860918 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2757b-daa9-4c82-8bc9-c0ac3e16694d None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:33.861196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2757b-daa9-4c82-8bc9-c0ac3e16694d None admin] PATH_INFO: `/v3/users/19f5836b0a7c48eb9b7f8198538b2d2f` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:33.866332 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2757b-daa9-4c82-8bc9-c0ac3e16694d None admin] RBAC: Authorizing `identity:get_user(user_id=19f5836b0a7c48eb9b7f8198538b2d2f)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:33.867744 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2757b-daa9-4c82-8bc9-c0ac3e16694d None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:33.869366 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 131/261] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:33 2022] GET /identity/v3/users/19f5836b0a7c48eb9b7f8198538b2d2f => generated 283 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:33.890584 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2757b-daa9-4c82-8bc9-c0ac3e16694d None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:33.952983 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd341f-5c4a-45e4-af3f-48ef1ebc4998 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:34.017083 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aabe93-787f-439e-a89f-ae93baf06443 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=a9dorbVNTD-ZzwUZFjPivw, audit_chain_id=['a9dorbVNTD-ZzwUZFjPivw']) at 0x7f8a1419e4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:34.017756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aabe93-787f-439e-a89f-ae93baf06443 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:34.018040 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aabe93-787f-439e-a89f-ae93baf06443 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:34.018314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aabe93-787f-439e-a89f-ae93baf06443 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:34.019036 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aabe93-787f-439e-a89f-ae93baf06443 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:34.019339 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aabe93-787f-439e-a89f-ae93baf06443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:34.020838 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aabe93-787f-439e-a89f-ae93baf06443 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:34.038055 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 131/262] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:47:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:34.044118 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aabe93-787f-439e-a89f-ae93baf06443 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:34.047794 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2757b-daa9-4c82-8bc9-c0ac3e16694d None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:34.064938 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:34.097964 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:34.112826 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933e853-cb4a-4abf-807c-6d1844722e1d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ndkiq5UYQkmlwLE2BbZ9LA, audit_chain_id=['Ndkiq5UYQkmlwLE2BbZ9LA']) at 0x7f8a0fe074f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:34.113453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933e853-cb4a-4abf-807c-6d1844722e1d None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:34.113770 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933e853-cb4a-4abf-807c-6d1844722e1d None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:34.114052 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933e853-cb4a-4abf-807c-6d1844722e1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:34.304518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aabe93-787f-439e-a89f-ae93baf06443 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:34.305053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933e853-cb4a-4abf-807c-6d1844722e1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:34.306567 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933e853-cb4a-4abf-807c-6d1844722e1d None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:34.371985 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44f622-61ec-429b-bbf8-b968a0437dd4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=a9dorbVNTD-ZzwUZFjPivw, audit_chain_id=['a9dorbVNTD-ZzwUZFjPivw']) at 0x7f8a141280a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:34.373199 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44f622-61ec-429b-bbf8-b968a0437dd4 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:34.373687 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44f622-61ec-429b-bbf8-b968a0437dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:34.374279 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44f622-61ec-429b-bbf8-b968a0437dd4 None admin] PATH_INFO: `/v3/users/19f5836b0a7c48eb9b7f8198538b2d2f` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:34.375531 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44f622-61ec-429b-bbf8-b968a0437dd4 None admin] RBAC: Authorizing `identity:get_user(user_id=19f5836b0a7c48eb9b7f8198538b2d2f)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:34.377208 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44f622-61ec-429b-bbf8-b968a0437dd4 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:34.387069 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 132/263] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:34 2022] GET /identity/v3/users/19f5836b0a7c48eb9b7f8198538b2d2f => generated 283 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:34.399730 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44f622-61ec-429b-bbf8-b968a0437dd4 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:34.518127 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 132/264] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:34.524388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933e853-cb4a-4abf-807c-6d1844722e1d None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:34.557657 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:34.625942 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:34.655776 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44f622-61ec-429b-bbf8-b968a0437dd4 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:34.715572 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e090d-6a9a-4c26-b089-82be86c9e797 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=a9dorbVNTD-ZzwUZFjPivw, audit_chain_id=['a9dorbVNTD-ZzwUZFjPivw']) at 0x7f8a1419c670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:34.716241 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e090d-6a9a-4c26-b089-82be86c9e797 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:34.716528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e090d-6a9a-4c26-b089-82be86c9e797 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:34.716811 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e090d-6a9a-4c26-b089-82be86c9e797 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:34.762775 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933e853-cb4a-4abf-807c-6d1844722e1d None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:34.838634 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e090d-6a9a-4c26-b089-82be86c9e797 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:34.840141 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e090d-6a9a-4c26-b089-82be86c9e797 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:34.843392 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f03de-8957-4685-9496-68c554342307 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ndkiq5UYQkmlwLE2BbZ9LA, audit_chain_id=['Ndkiq5UYQkmlwLE2BbZ9LA']) at 0x7f8a0fe6bcd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:34.844180 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f03de-8957-4685-9496-68c554342307 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:34.844468 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f03de-8957-4685-9496-68c554342307 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:34.844750 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f03de-8957-4685-9496-68c554342307 None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:34.846029 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f03de-8957-4685-9496-68c554342307 None admin] RBAC: Authorizing `identity:get_project(project_id=fa144b85a37b4dd191df360058c783d1)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:34.847489 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f03de-8957-4685-9496-68c554342307 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:34.849231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 133/265] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:34 2022] GET /identity/v3/projects/fa144b85a37b4dd191df360058c783d1 => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:34.852369 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0f384-144d-41fd-bafc-5bc3b51c230c None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:34.852809 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0f384-144d-41fd-bafc-5bc3b51c230c None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:34.853240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0f384-144d-41fd-bafc-5bc3b51c230c None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:34.854666 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 134/266] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:34.860393 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0f384-144d-41fd-bafc-5bc3b51c230c None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:34.999914 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:35.026548 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:35.043540 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 133/267] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:35.046355 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a4a4f-d93a-4eb3-846a-179f88cf5a84 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:35.047015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a4a4f-d93a-4eb3-846a-179f88cf5a84 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:35.047491 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a4a4f-d93a-4eb3-846a-179f88cf5a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:35.066342 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0f384-144d-41fd-bafc-5bc3b51c230c None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:35.089711 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-246a4a4f-d93a-4eb3-846a-179f88cf5a84 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:35.093099 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-246a4a4f-d93a-4eb3-846a-179f88cf5a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:35.136782 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16b1f4-d4cc-4f06-be46-1cd044efe75b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ndkiq5UYQkmlwLE2BbZ9LA, audit_chain_id=['Ndkiq5UYQkmlwLE2BbZ9LA']) at 0x7f8a0fdd5df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:35.137411 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16b1f4-d4cc-4f06-be46-1cd044efe75b None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:35.137723 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16b1f4-d4cc-4f06-be46-1cd044efe75b None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:35.138025 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16b1f4-d4cc-4f06-be46-1cd044efe75b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:35.139985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16b1f4-d4cc-4f06-be46-1cd044efe75b None admin] RBAC: Adding query filter params (role.id=6ca03befbf3a456eae350bc7e583488f, scope.project.id=fa144b85a37b4dd191df360058c783d1, user.id=19f5836b0a7c48eb9b7f8198538b2d2f) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:35.140305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16b1f4-d4cc-4f06-be46-1cd044efe75b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:35.142319 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16b1f4-d4cc-4f06-be46-1cd044efe75b None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:35.156592 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 135/268] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:47:34 2022] GET /identity/v3/role_assignments?user.id=19f5836b0a7c48eb9b7f8198538b2d2f&scope.project.id=fa144b85a37b4dd191df360058c783d1&role.id=6ca03befbf3a456eae350bc7e583488f => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:35.159646 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16b1f4-d4cc-4f06-be46-1cd044efe75b None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:35.259387 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 134/269] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:35.297460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a4a4f-d93a-4eb3-846a-179f88cf5a84 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:35.415339 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16b1f4-d4cc-4f06-be46-1cd044efe75b None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:35.474787 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdda9db-6ae0-422d-9e88-2fd2f831bd0e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=a9dorbVNTD-ZzwUZFjPivw, audit_chain_id=['a9dorbVNTD-ZzwUZFjPivw']) at 0x7f8a0fe7ff70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:35.475488 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdda9db-6ae0-422d-9e88-2fd2f831bd0e None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:35.475777 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdda9db-6ae0-422d-9e88-2fd2f831bd0e None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:35.476063 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdda9db-6ae0-422d-9e88-2fd2f831bd0e None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:35.481056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdda9db-6ae0-422d-9e88-2fd2f831bd0e None admin] RBAC: Authorizing `identity:get_project(project_id=fa144b85a37b4dd191df360058c783d1)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:35.483312 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdda9db-6ae0-422d-9e88-2fd2f831bd0e None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:35.489507 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 136/270] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:35 2022] GET /identity/v3/projects/fa144b85a37b4dd191df360058c783d1 => generated 302 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:35.491906 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdda9db-6ae0-422d-9e88-2fd2f831bd0e None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:35.504108 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a4a4f-d93a-4eb3-846a-179f88cf5a84 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:35.517713 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:35.530175 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:35.585376 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9b531-4980-4dec-b2a4-10a06f0e4d38 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Qf-Cj_19Smm4MM7817ZtCw, audit_chain_id=['Qf-Cj_19Smm4MM7817ZtCw']) at 0x7f8a1419c0a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:35.586817 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9b531-4980-4dec-b2a4-10a06f0e4d38 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:35.587102 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9b531-4980-4dec-b2a4-10a06f0e4d38 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:35.587377 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9b531-4980-4dec-b2a4-10a06f0e4d38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:35.611334 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9b531-4980-4dec-b2a4-10a06f0e4d38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:35.617641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-1cb9b531-4980-4dec-b2a4-10a06f0e4d38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:35.617641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:35.617641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:35.617641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:35.617641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:35.617641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:35.617641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:35.617641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:35.617641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:35.617641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:35.617641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:35.617641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:35.617641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:35.617641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:35.617641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:35.617641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:35.618760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:35.618760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:35.618760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:35.618760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:35.618760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:35.618760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:35.618760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:35.618760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:35.618760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:35.618760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:35.618760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:35.618760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:35.618760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:35.618760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:35.618760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:35.618760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:35.619747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:35.619747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:35.619747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:35.619747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:35.619747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:35.619747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:35.619747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:35.619747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:35.619747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:35.619747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:35.619747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:35.619747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:35.623016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 135/271] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:47:35.625003 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b721f-201e-4618-96b6-22dbf10c99e2 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:35.625440 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b721f-201e-4618-96b6-22dbf10c99e2 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:35.625960 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b721f-201e-4618-96b6-22dbf10c99e2 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:35.628097 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 136/272] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:35.629000 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b721f-201e-4618-96b6-22dbf10c99e2 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:35.661430 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdda9db-6ae0-422d-9e88-2fd2f831bd0e None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:35.709947 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470028ea-c19c-48f5-b8c1-71b0a93c51ef None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=a9dorbVNTD-ZzwUZFjPivw, audit_chain_id=['a9dorbVNTD-ZzwUZFjPivw']) at 0x7f8a0fde0ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:35.710611 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470028ea-c19c-48f5-b8c1-71b0a93c51ef None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:35.710895 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470028ea-c19c-48f5-b8c1-71b0a93c51ef None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:35.711310 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470028ea-c19c-48f5-b8c1-71b0a93c51ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:35.712106 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470028ea-c19c-48f5-b8c1-71b0a93c51ef None admin] RBAC: Adding query filter params (role.id=e0342a5e42664f35948f522071411514, scope.project.id=fa144b85a37b4dd191df360058c783d1, user.id=19f5836b0a7c48eb9b7f8198538b2d2f) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:35.712424 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470028ea-c19c-48f5-b8c1-71b0a93c51ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:35.715535 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470028ea-c19c-48f5-b8c1-71b0a93c51ef None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:35.723158 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 137/273] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:47:35 2022] GET /identity/v3/role_assignments?user.id=19f5836b0a7c48eb9b7f8198538b2d2f&scope.project.id=fa144b85a37b4dd191df360058c783d1&role.id=e0342a5e42664f35948f522071411514 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:35.724386 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53045cf2-795a-4164-a91d-9c7e160fc75d None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:35.724678 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53045cf2-795a-4164-a91d-9c7e160fc75d None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:35.724956 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53045cf2-795a-4164-a91d-9c7e160fc75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:35.749618 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-53045cf2-795a-4164-a91d-9c7e160fc75d None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:35.751699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-53045cf2-795a-4164-a91d-9c7e160fc75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:35.764867 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b721f-201e-4618-96b6-22dbf10c99e2 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:35.820385 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7646209-182a-469a-8310-4d4c9c870b7d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Qf-Cj_19Smm4MM7817ZtCw, audit_chain_id=['Qf-Cj_19Smm4MM7817ZtCw']) at 0x7f8a1419af10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:35.821182 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7646209-182a-469a-8310-4d4c9c870b7d None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:35.821606 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7646209-182a-469a-8310-4d4c9c870b7d None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:35.821904 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7646209-182a-469a-8310-4d4c9c870b7d None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:35.822640 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7646209-182a-469a-8310-4d4c9c870b7d None admin] RBAC: Adding query filter params (name=member) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:35.823226 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7646209-182a-469a-8310-4d4c9c870b7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:35.825529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7646209-182a-469a-8310-4d4c9c870b7d None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:35.836280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 138/274] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:35.837252 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 137/275] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:35.837934 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d645ffa-b6ca-45eb-8d03-592739c8c591 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:35.838321 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d645ffa-b6ca-45eb-8d03-592739c8c591 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:35.838695 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d645ffa-b6ca-45eb-8d03-592739c8c591 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:35.840202 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 139/276] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:35.843238 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7646209-182a-469a-8310-4d4c9c870b7d None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:35.860097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65946ac7-51d1-4c02-b366-e91d6265e1dc None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:35.861162 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65946ac7-51d1-4c02-b366-e91d6265e1dc None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:35.861634 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65946ac7-51d1-4c02-b366-e91d6265e1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:35.876906 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:35.884901 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-65946ac7-51d1-4c02-b366-e91d6265e1dc None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:35.886552 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-65946ac7-51d1-4c02-b366-e91d6265e1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:35.902775 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:35.974004 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 140/277] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:35.975127 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65946ac7-51d1-4c02-b366-e91d6265e1dc None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:35.989506 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7646209-182a-469a-8310-4d4c9c870b7d None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:36.036707 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb673e-7792-43af-9420-646697c90d1c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Qf-Cj_19Smm4MM7817ZtCw, audit_chain_id=['Qf-Cj_19Smm4MM7817ZtCw']) at 0x7f8a1413de20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:36.037636 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb673e-7792-43af-9420-646697c90d1c None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:36.037931 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb673e-7792-43af-9420-646697c90d1c None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:36.038209 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb673e-7792-43af-9420-646697c90d1c None admin] PATH_INFO: `/v3/users/4356fb7a7b6244a5bf9fabdf4a053a6d` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:36.054454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb673e-7792-43af-9420-646697c90d1c None admin] RBAC: Authorizing `identity:get_user(user_id=4356fb7a7b6244a5bf9fabdf4a053a6d)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:36.055999 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb673e-7792-43af-9420-646697c90d1c None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:36.058074 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 138/278] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:35 2022] GET /identity/v3/users/4356fb7a7b6244a5bf9fabdf4a053a6d => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:36.058975 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb673e-7792-43af-9420-646697c90d1c None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:36.099544 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65946ac7-51d1-4c02-b366-e91d6265e1dc None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:36.139510 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067179d1-b4cb-4357-83e8-4f6367c7b1be None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ztiUZpyES2KQTxGSmBY2lA, audit_chain_id=['ztiUZpyES2KQTxGSmBY2lA']) at 0x7f8a1434fb20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:36.140226 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067179d1-b4cb-4357-83e8-4f6367c7b1be None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:36.140513 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067179d1-b4cb-4357-83e8-4f6367c7b1be None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:36.140788 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067179d1-b4cb-4357-83e8-4f6367c7b1be None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:36.144052 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:36.152939 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067179d1-b4cb-4357-83e8-4f6367c7b1be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:36.158632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-067179d1-b4cb-4357-83e8-4f6367c7b1be None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:47:36.158632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:36.158632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:36.158632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:36.158632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:36.158632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:36.158632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:36.158632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:36.158632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:36.158632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:36.158632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:36.158632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:36.158632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:36.158632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:36.158632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:36.158632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:36.159504 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:36.159504 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:36.159504 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:36.159504 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:36.159504 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:36.159504 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:36.159504 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:36.159504 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:36.159504 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:36.159504 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:36.159504 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:36.159504 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:36.159504 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:36.159504 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:36.159504 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:36.159504 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:36.160317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:36.160317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:36.160317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:36.160317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:36.160317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:36.160317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:36.160317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:36.160317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:36.160317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:36.160317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:36.160317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:47:36.160317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:47:36.160317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 141/279] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:36.160986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067179d1-b4cb-4357-83e8-4f6367c7b1be None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:36.173534 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:36.177486 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb673e-7792-43af-9420-646697c90d1c None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:36.215499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4229f-5093-43ba-b64c-aa27cca3c513 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8SM6ZkKTRbSMZe_UZmnTVw, audit_chain_id=['8SM6ZkKTRbSMZe_UZmnTVw']) at 0x7f8a1419adf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:36.216868 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4229f-5093-43ba-b64c-aa27cca3c513 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:36.217168 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4229f-5093-43ba-b64c-aa27cca3c513 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:36.217440 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4229f-5093-43ba-b64c-aa27cca3c513 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:36.218788 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4229f-5093-43ba-b64c-aa27cca3c513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:36.220267 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4229f-5093-43ba-b64c-aa27cca3c513 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:36.222053 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 139/280] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:47:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:36.222643 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4229f-5093-43ba-b64c-aa27cca3c513 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:36.271019 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067179d1-b4cb-4357-83e8-4f6367c7b1be None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:36.304959 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c5128-d2be-4e8d-a749-84d34747cec1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Qf-Cj_19Smm4MM7817ZtCw, audit_chain_id=['Qf-Cj_19Smm4MM7817ZtCw']) at 0x7f8a14082a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:36.305586 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c5128-d2be-4e8d-a749-84d34747cec1 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:36.305886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c5128-d2be-4e8d-a749-84d34747cec1 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:36.306161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c5128-d2be-4e8d-a749-84d34747cec1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:36.306942 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c5128-d2be-4e8d-a749-84d34747cec1 None admin] RBAC: Adding query filter params (role.id=c57f45d724fe45009701c9b2706d661c, user.id=4356fb7a7b6244a5bf9fabdf4a053a6d, scope.system=all) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:36.307254 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c5128-d2be-4e8d-a749-84d34747cec1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:36.308702 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c5128-d2be-4e8d-a749-84d34747cec1 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:36.313769 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 142/281] 10.222.0.47 () {56 vars in 1308 bytes} [Mon Jul 25 22:47:36 2022] GET /identity/v3/role_assignments?user.id=4356fb7a7b6244a5bf9fabdf4a053a6d&scope.system=all&role.id=c57f45d724fe45009701c9b2706d661c => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:36.313769 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c5128-d2be-4e8d-a749-84d34747cec1 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:36.327688 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4229f-5093-43ba-b64c-aa27cca3c513 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:36.366381 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355df10-d6a3-40ac-b70b-2647d8106864 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ztiUZpyES2KQTxGSmBY2lA, audit_chain_id=['ztiUZpyES2KQTxGSmBY2lA']) at 0x7f8a14131a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:36.367023 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355df10-d6a3-40ac-b70b-2647d8106864 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:36.367304 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355df10-d6a3-40ac-b70b-2647d8106864 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:36.367579 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355df10-d6a3-40ac-b70b-2647d8106864 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:36.368312 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355df10-d6a3-40ac-b70b-2647d8106864 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:36.368621 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355df10-d6a3-40ac-b70b-2647d8106864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:36.370100 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355df10-d6a3-40ac-b70b-2647d8106864 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:36.380364 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 140/282] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:36.381503 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e113cc8-72e8-4543-9dda-25dfb508ffb3 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:36.381828 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e113cc8-72e8-4543-9dda-25dfb508ffb3 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:36.382108 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e113cc8-72e8-4543-9dda-25dfb508ffb3 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:36.383498 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 141/283] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:36.386250 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:36.389197 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e113cc8-72e8-4543-9dda-25dfb508ffb3 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:36.423740 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:36.444812 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c5128-d2be-4e8d-a749-84d34747cec1 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:36.488598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540bea4-5b7b-4f24-9fa7-b36682d201c0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8SM6ZkKTRbSMZe_UZmnTVw, audit_chain_id=['8SM6ZkKTRbSMZe_UZmnTVw']) at 0x7f8a0fdce340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:36.489231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540bea4-5b7b-4f24-9fa7-b36682d201c0 None admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:36.489518 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540bea4-5b7b-4f24-9fa7-b36682d201c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:36.489849 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540bea4-5b7b-4f24-9fa7-b36682d201c0 None admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:36.490539 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540bea4-5b7b-4f24-9fa7-b36682d201c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:36.492026 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540bea4-5b7b-4f24-9fa7-b36682d201c0 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:36.518107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 143/284] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 22:47:36 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:47:36.519520 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f6ce1-a3b1-49c5-af4b-62181ef16794 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:36.519809 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f6ce1-a3b1-49c5-af4b-62181ef16794 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:36.520183 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f6ce1-a3b1-49c5-af4b-62181ef16794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:36.521763 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e113cc8-72e8-4543-9dda-25dfb508ffb3 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:36.539393 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-527f6ce1-a3b1-49c5-af4b-62181ef16794 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:36.540635 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-527f6ce1-a3b1-49c5-af4b-62181ef16794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:36.586995 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08678e01-bfe5-4aba-a4e1-b0c77c82497a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ztiUZpyES2KQTxGSmBY2lA, audit_chain_id=['ztiUZpyES2KQTxGSmBY2lA']) at 0x7f8a0fe47100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:36.588037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08678e01-bfe5-4aba-a4e1-b0c77c82497a None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:36.589884 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08678e01-bfe5-4aba-a4e1-b0c77c82497a None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:36.590537 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08678e01-bfe5-4aba-a4e1-b0c77c82497a None admin] PATH_INFO: `/v3/users/78c270a1d38c4e16984fd4c6afb48739` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:36.593988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08678e01-bfe5-4aba-a4e1-b0c77c82497a None admin] RBAC: Authorizing `identity:get_user(user_id=78c270a1d38c4e16984fd4c6afb48739)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:36.596139 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08678e01-bfe5-4aba-a4e1-b0c77c82497a None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:36.599507 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 142/285] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:36 2022] GET /identity/v3/users/78c270a1d38c4e16984fd4c6afb48739 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:36.608578 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08678e01-bfe5-4aba-a4e1-b0c77c82497a None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:36.645672 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 144/286] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:36.674503 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f6ce1-a3b1-49c5-af4b-62181ef16794 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:36.738047 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:36.740029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:36.747142 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08678e01-bfe5-4aba-a4e1-b0c77c82497a None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:36.801287 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4c85e-13b1-4810-90ee-646b3bf50b42 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ztiUZpyES2KQTxGSmBY2lA, audit_chain_id=['ztiUZpyES2KQTxGSmBY2lA']) at 0x7f8a14127a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:36.802016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4c85e-13b1-4810-90ee-646b3bf50b42 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:36.802196 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4c85e-13b1-4810-90ee-646b3bf50b42 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:36.802436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4c85e-13b1-4810-90ee-646b3bf50b42 None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:36.803622 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4c85e-13b1-4810-90ee-646b3bf50b42 None admin] RBAC: Authorizing `identity:get_project(project_id=fa144b85a37b4dd191df360058c783d1)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:36.805193 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4c85e-13b1-4810-90ee-646b3bf50b42 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:36.807253 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 143/287] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:36 2022] GET /identity/v3/projects/fa144b85a37b4dd191df360058c783d1 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:36.812214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f6ce1-a3b1-49c5-af4b-62181ef16794 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:36.815772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4c85e-13b1-4810-90ee-646b3bf50b42 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:36.856325 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191381c5-0c8e-46d9-80c3-273b5f7464cb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9sKM9seR_ea6pnXmS1xgg, audit_chain_id=['H9sKM9seR_ea6pnXmS1xgg']) at 0x7f8a142fa790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:36.857053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191381c5-0c8e-46d9-80c3-273b5f7464cb None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:36.857860 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191381c5-0c8e-46d9-80c3-273b5f7464cb None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:36.858202 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191381c5-0c8e-46d9-80c3-273b5f7464cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:36.875494 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191381c5-0c8e-46d9-80c3-273b5f7464cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:36.880699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-191381c5-0c8e-46d9-80c3-273b5f7464cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:36.880699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:36.880699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:36.880699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:36.880699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:36.880699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:36.880699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:36.880699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:36.880699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:36.880699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:36.880699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:36.880699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:36.880699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:36.880699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:36.880699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:36.880699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:36.881647 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:36.881647 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:36.881647 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:36.881647 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:36.881647 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:36.881647 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:36.881647 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:36.881647 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:36.881647 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:36.881647 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:36.881647 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:36.881647 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:36.881647 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:36.881647 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:36.881647 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:36.881647 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:36.882498 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:36.882498 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:36.882498 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:36.882498 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:36.882498 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:36.882498 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:36.882498 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:36.882498 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:36.882498 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:36.882498 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:36.882498 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:36.882498 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:47:36.882498 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 145/288] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:47:36.889908 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191381c5-0c8e-46d9-80c3-273b5f7464cb None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:36.954805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4c85e-13b1-4810-90ee-646b3bf50b42 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:36.998577 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadcb99-e246-4666-a750-00d8d4100184 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ztiUZpyES2KQTxGSmBY2lA, audit_chain_id=['ztiUZpyES2KQTxGSmBY2lA']) at 0x7f8a1412a0a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:36.999661 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadcb99-e246-4666-a750-00d8d4100184 None admin] REQUEST_METHOD: `PUT` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:37.000148 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadcb99-e246-4666-a750-00d8d4100184 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:37.000435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadcb99-e246-4666-a750-00d8d4100184 None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1/users/78c270a1d38c4e16984fd4c6afb48739/roles/862b3fa9d6834bd3b14681fc489500a7` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:37.002514 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadcb99-e246-4666-a750-00d8d4100184 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa144b85a37b4dd191df360058c783d1, user_id=78c270a1d38c4e16984fd4c6afb48739, role_id=862b3fa9d6834bd3b14681fc489500a7)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:37.003963 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadcb99-e246-4666-a750-00d8d4100184 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:37.019126 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191381c5-0c8e-46d9-80c3-273b5f7464cb None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:37.021417 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 144/289] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 22:47:36 2022] PUT /identity/v3/projects/fa144b85a37b4dd191df360058c783d1/users/78c270a1d38c4e16984fd4c6afb48739/roles/862b3fa9d6834bd3b14681fc489500a7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:47:37.033954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:37.067804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421dfbe-50ac-4119-8a7d-3abea2a589b7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9sKM9seR_ea6pnXmS1xgg, audit_chain_id=['H9sKM9seR_ea6pnXmS1xgg']) at 0x7f8a0fe253a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:37.068865 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421dfbe-50ac-4119-8a7d-3abea2a589b7 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:37.069413 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421dfbe-50ac-4119-8a7d-3abea2a589b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:37.070341 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421dfbe-50ac-4119-8a7d-3abea2a589b7 None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:37.071660 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421dfbe-50ac-4119-8a7d-3abea2a589b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:37.072182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421dfbe-50ac-4119-8a7d-3abea2a589b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:37.073970 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421dfbe-50ac-4119-8a7d-3abea2a589b7 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:37.090204 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 146/290] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:37.091666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadcb99-e246-4666-a750-00d8d4100184 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:37.142369 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:37.254864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadcb99-e246-4666-a750-00d8d4100184 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:37.305254 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a1d18-f6a2-4382-bc4b-22867ef7e152 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9sKM9seR_ea6pnXmS1xgg, audit_chain_id=['H9sKM9seR_ea6pnXmS1xgg']) at 0x7f8a14136f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:37.305933 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a1d18-f6a2-4382-bc4b-22867ef7e152 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:37.306221 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a1d18-f6a2-4382-bc4b-22867ef7e152 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:37.306504 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a1d18-f6a2-4382-bc4b-22867ef7e152 None admin] PATH_INFO: `/v3/users/66f750e9ae444c50babf0f33b2192fea` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:37.311024 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a1d18-f6a2-4382-bc4b-22867ef7e152 None admin] RBAC: Authorizing `identity:get_user(user_id=66f750e9ae444c50babf0f33b2192fea)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:37.312500 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a1d18-f6a2-4382-bc4b-22867ef7e152 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:37.314510 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 145/291] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:37 2022] GET /identity/v3/users/66f750e9ae444c50babf0f33b2192fea => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:37.320097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421dfbe-50ac-4119-8a7d-3abea2a589b7 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:37.442953 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421dfbe-50ac-4119-8a7d-3abea2a589b7 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:37.490308 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c363056-5bce-44d5-bd7f-14d27f3d9af2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9sKM9seR_ea6pnXmS1xgg, audit_chain_id=['H9sKM9seR_ea6pnXmS1xgg']) at 0x7f8a0fdd2370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:37.491006 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c363056-5bce-44d5-bd7f-14d27f3d9af2 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:37.491339 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c363056-5bce-44d5-bd7f-14d27f3d9af2 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:37.491628 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c363056-5bce-44d5-bd7f-14d27f3d9af2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:37.537681 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:37.589223 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c363056-5bce-44d5-bd7f-14d27f3d9af2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:37.590669 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c363056-5bce-44d5-bd7f-14d27f3d9af2 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:37.711107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 147/292] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:37.717217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a1d18-f6a2-4382-bc4b-22867ef7e152 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:37.845261 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:37.855967 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a1d18-f6a2-4382-bc4b-22867ef7e152 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:37.905564 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b44db-147f-466c-9094-06555a7822f8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9sKM9seR_ea6pnXmS1xgg, audit_chain_id=['H9sKM9seR_ea6pnXmS1xgg']) at 0x7f8a14198160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:37.906246 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b44db-147f-466c-9094-06555a7822f8 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:37.906537 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b44db-147f-466c-9094-06555a7822f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:37.906817 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b44db-147f-466c-9094-06555a7822f8 None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:37.908020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b44db-147f-466c-9094-06555a7822f8 None admin] RBAC: Authorizing `identity:get_project(project_id=fa144b85a37b4dd191df360058c783d1)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:37.909466 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b44db-147f-466c-9094-06555a7822f8 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:37.911326 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 146/293] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:37 2022] GET /identity/v3/projects/fa144b85a37b4dd191df360058c783d1 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:37.917327 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c363056-5bce-44d5-bd7f-14d27f3d9af2 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:38.001383 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:38.037868 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c363056-5bce-44d5-bd7f-14d27f3d9af2 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:38.072785 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abe2c8-5b08-4373-a3ef-253afadbcf2c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9sKM9seR_ea6pnXmS1xgg, audit_chain_id=['H9sKM9seR_ea6pnXmS1xgg']) at 0x7f8a0fdf1520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:38.073411 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abe2c8-5b08-4373-a3ef-253afadbcf2c None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:38.073731 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abe2c8-5b08-4373-a3ef-253afadbcf2c None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:38.074011 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abe2c8-5b08-4373-a3ef-253afadbcf2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:38.074802 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13abe2c8-5b08-4373-a3ef-253afadbcf2c None admin] RBAC: Adding query filter params (role.id=c57f45d724fe45009701c9b2706d661c, scope.project.id=fa144b85a37b4dd191df360058c783d1, user.id=66f750e9ae444c50babf0f33b2192fea) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:38.075116 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13abe2c8-5b08-4373-a3ef-253afadbcf2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:38.077378 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13abe2c8-5b08-4373-a3ef-253afadbcf2c None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:38.083419 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 148/294] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:47:37 2022] GET /identity/v3/role_assignments?user.id=66f750e9ae444c50babf0f33b2192fea&scope.project.id=fa144b85a37b4dd191df360058c783d1&role.id=c57f45d724fe45009701c9b2706d661c => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:38.994133 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b5acf-44bd-4db1-a553-d32bebfafa40 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:38.994647 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b5acf-44bd-4db1-a553-d32bebfafa40 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:38.994749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b5acf-44bd-4db1-a553-d32bebfafa40 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:38.996366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 147/295] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:39.001805 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bac411-c6d4-4268-826e-67d6a7043b15 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:39.002645 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bac411-c6d4-4268-826e-67d6a7043b15 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:39.003129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bac411-c6d4-4268-826e-67d6a7043b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:39.022753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-b0bac411-c6d4-4268-826e-67d6a7043b15 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:39.024293 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-b0bac411-c6d4-4268-826e-67d6a7043b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:39.095198 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 149/296] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:39.118495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b5acf-44bd-4db1-a553-d32bebfafa40 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:39.237215 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b5acf-44bd-4db1-a553-d32bebfafa40 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:39.275796 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470e665-b896-46b0-ae27-729d7414a5a1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=t7YxlQsyQ4mCCi44eo90Pw, audit_chain_id=['t7YxlQsyQ4mCCi44eo90Pw']) at 0x7f8a142dbb20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:39.276455 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470e665-b896-46b0-ae27-729d7414a5a1 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:39.276743 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470e665-b896-46b0-ae27-729d7414a5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:39.277027 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470e665-b896-46b0-ae27-729d7414a5a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:39.288166 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470e665-b896-46b0-ae27-729d7414a5a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:39.293624 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-6470e665-b896-46b0-ae27-729d7414a5a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:39.293624 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:39.293624 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:39.293624 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:39.293624 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:39.293624 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:39.293624 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:39.293624 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:39.293624 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:39.293624 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:39.293624 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:39.293624 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:39.293624 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:39.293624 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:39.293624 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:39.293624 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:39.295704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:39.295704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:39.295704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:39.295704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:39.295704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:39.295704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:39.295704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:39.295704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:39.295704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:39.295704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:39.295704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:39.295704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:39.295704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:39.295704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:39.295704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:39.295704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:39.296526 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:39.296526 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:39.296526 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:39.296526 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:39.296526 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:39.296526 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:39.296526 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:39.296526 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:39.296526 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:39.296526 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:39.296526 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:39.296526 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:39.296526 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 148/297] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:39.305883 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bac411-c6d4-4268-826e-67d6a7043b15 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:39.373961 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:39.393759 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696d951-2018-4f53-94e9-fba5e0959ac8 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:39.394049 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696d951-2018-4f53-94e9-fba5e0959ac8 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:39.394321 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696d951-2018-4f53-94e9-fba5e0959ac8 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:39.395835 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 149/298] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:39.401547 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b39de-45ec-4e2f-be74-8857a19dc583 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:39.402316 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b39de-45ec-4e2f-be74-8857a19dc583 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:39.402793 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b39de-45ec-4e2f-be74-8857a19dc583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:39.424312 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bac411-c6d4-4268-826e-67d6a7043b15 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:39.424611 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-2b6b39de-45ec-4e2f-be74-8857a19dc583 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:39.425821 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-2b6b39de-45ec-4e2f-be74-8857a19dc583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:39.440837 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:39.468432 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d3949-287e-4166-9986-f947f640f571 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=t7YxlQsyQ4mCCi44eo90Pw, audit_chain_id=['t7YxlQsyQ4mCCi44eo90Pw']) at 0x7f8a0fe942e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:39.469086 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d3949-287e-4166-9986-f947f640f571 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:39.469378 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d3949-287e-4166-9986-f947f640f571 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:39.469695 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d3949-287e-4166-9986-f947f640f571 None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:39.470454 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d3949-287e-4166-9986-f947f640f571 None admin] RBAC: Adding query filter params (name=member) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:39.470768 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d3949-287e-4166-9986-f947f640f571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:39.472272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d3949-287e-4166-9986-f947f640f571 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:39.488843 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 150/299] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:39.494961 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d3949-287e-4166-9986-f947f640f571 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:39.521602 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 150/300] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:39.541782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b39de-45ec-4e2f-be74-8857a19dc583 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:39.620196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d3949-287e-4166-9986-f947f640f571 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:39.646741 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:39.659482 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1e7f6-8a62-4baa-ae55-29f9e43ce40c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=t7YxlQsyQ4mCCi44eo90Pw, audit_chain_id=['t7YxlQsyQ4mCCi44eo90Pw']) at 0x7f8a0fdf10d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:39.660137 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1e7f6-8a62-4baa-ae55-29f9e43ce40c None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:39.660427 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1e7f6-8a62-4baa-ae55-29f9e43ce40c None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:39.660710 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1e7f6-8a62-4baa-ae55-29f9e43ce40c None admin] PATH_INFO: `/v3/users/4356fb7a7b6244a5bf9fabdf4a053a6d` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:39.661914 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1e7f6-8a62-4baa-ae55-29f9e43ce40c None admin] RBAC: Authorizing `identity:get_user(user_id=4356fb7a7b6244a5bf9fabdf4a053a6d)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:39.663440 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1e7f6-8a62-4baa-ae55-29f9e43ce40c None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:39.665189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 151/301] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:39 2022] GET /identity/v3/users/4356fb7a7b6244a5bf9fabdf4a053a6d => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:39.666191 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b1198-46d0-417c-aaa7-42783ecef6b3 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:39.666479 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b1198-46d0-417c-aaa7-42783ecef6b3 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:39.666759 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b1198-46d0-417c-aaa7-42783ecef6b3 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:39.672979 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 152/302] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:39.672979 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b1198-46d0-417c-aaa7-42783ecef6b3 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:39.674224 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b39de-45ec-4e2f-be74-8857a19dc583 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:39.711573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab42ca8-593c-43a6-af41-bdf8e04221e9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZXPntzRDTLeUPa-KSXY4wQ, audit_chain_id=['ZXPntzRDTLeUPa-KSXY4wQ']) at 0x7f8a14176550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:39.712229 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab42ca8-593c-43a6-af41-bdf8e04221e9 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:39.712519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab42ca8-593c-43a6-af41-bdf8e04221e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:39.712798 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab42ca8-593c-43a6-af41-bdf8e04221e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:39.726942 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab42ca8-593c-43a6-af41-bdf8e04221e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:39.733070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-aab42ca8-593c-43a6-af41-bdf8e04221e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:47:39.733070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:39.733070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:39.733070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:39.733070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:39.733070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:39.733070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:39.733070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:39.733070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:39.733070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:39.733070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:39.733070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:39.733070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:39.733070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:39.733070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:39.733070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:39.733988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:39.733988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:39.733988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:39.733988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:39.733988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:39.733988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:39.733988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:39.733988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:39.733988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:39.733988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:39.733988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:39.733988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:39.733988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:39.733988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:39.733988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:39.733988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:39.734801 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:39.734801 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:39.734801 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:39.734801 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:39.734801 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:39.734801 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:39.734801 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:39.734801 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:39.734801 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:39.734801 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:39.734801 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:47:39.734801 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:39.735420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 151/303] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:39.737028 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b6ce5-973f-481e-a6c7-0928246238a1 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:39.737317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b6ce5-973f-481e-a6c7-0928246238a1 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:39.737612 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b6ce5-973f-481e-a6c7-0928246238a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:39.754768 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-a57b6ce5-973f-481e-a6c7-0928246238a1 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:39.755959 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-a57b6ce5-973f-481e-a6c7-0928246238a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:39.758706 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:39.787834 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b1198-46d0-417c-aaa7-42783ecef6b3 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:39.820664 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c5b02-188e-4b1e-a5ea-3ffec4a8866c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=t7YxlQsyQ4mCCi44eo90Pw, audit_chain_id=['t7YxlQsyQ4mCCi44eo90Pw']) at 0x7f8a0fe25d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:39.821247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c5b02-188e-4b1e-a5ea-3ffec4a8866c None admin] REQUEST_METHOD: `PUT` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:39.821523 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c5b02-188e-4b1e-a5ea-3ffec4a8866c None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:39.821826 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c5b02-188e-4b1e-a5ea-3ffec4a8866c None admin] PATH_INFO: `/v3/system/users/4356fb7a7b6244a5bf9fabdf4a053a6d/roles/c57f45d724fe45009701c9b2706d661c` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:39.823258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c5b02-188e-4b1e-a5ea-3ffec4a8866c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4356fb7a7b6244a5bf9fabdf4a053a6d, role_id=c57f45d724fe45009701c9b2706d661c)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:39.824319 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 152/304] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:39.824703 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c5b02-188e-4b1e-a5ea-3ffec4a8866c None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:39.826733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b6ce5-973f-481e-a6c7-0928246238a1 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:39.848706 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 153/305] 10.222.0.47 () {58 vars in 1334 bytes} [Mon Jul 25 22:47:39 2022] PUT /identity/v3/system/users/4356fb7a7b6244a5bf9fabdf4a053a6d/roles/c57f45d724fe45009701c9b2706d661c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:47:39.860185 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7137bef-57b4-4348-9337-082eeb56d0b2 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:39.860484 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7137bef-57b4-4348-9337-082eeb56d0b2 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:39.860773 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7137bef-57b4-4348-9337-082eeb56d0b2 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:39.862214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 154/306] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:39 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:39.867723 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7137bef-57b4-4348-9337-082eeb56d0b2 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:39.943113 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:39.950823 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b6ce5-973f-481e-a6c7-0928246238a1 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:39.993157 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a2a58-2102-4586-8414-03bc0d3f2c2f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZXPntzRDTLeUPa-KSXY4wQ, audit_chain_id=['ZXPntzRDTLeUPa-KSXY4wQ']) at 0x7f8a141a1250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:39.993878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a2a58-2102-4586-8414-03bc0d3f2c2f None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:39.994192 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a2a58-2102-4586-8414-03bc0d3f2c2f None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:39.994728 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a2a58-2102-4586-8414-03bc0d3f2c2f None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:39.995162 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a2a58-2102-4586-8414-03bc0d3f2c2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:39.995472 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a2a58-2102-4586-8414-03bc0d3f2c2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:39.996888 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a2a58-2102-4586-8414-03bc0d3f2c2f None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:39.999331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7137bef-57b4-4348-9337-082eeb56d0b2 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:40.009636 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 153/307] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:40.009636 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3e095-3aa8-4451-8d2c-d9e7dd53757d None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:40.009636 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3e095-3aa8-4451-8d2c-d9e7dd53757d None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:40.009636 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3e095-3aa8-4451-8d2c-d9e7dd53757d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:40.018065 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:40.033075 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-e2f3e095-3aa8-4451-8d2c-d9e7dd53757d None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:40.034284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-e2f3e095-3aa8-4451-8d2c-d9e7dd53757d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:40.047473 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db45f1-a522-4bad-a5c9-6bf7ea341a6c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=JvcQa--xTkKmji0VpR7N2g, audit_chain_id=['JvcQa--xTkKmji0VpR7N2g']) at 0x7f8a0fdce3a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:40.048125 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db45f1-a522-4bad-a5c9-6bf7ea341a6c None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:40.048407 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db45f1-a522-4bad-a5c9-6bf7ea341a6c None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:40.048678 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db45f1-a522-4bad-a5c9-6bf7ea341a6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:40.049901 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db45f1-a522-4bad-a5c9-6bf7ea341a6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:40.051333 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db45f1-a522-4bad-a5c9-6bf7ea341a6c None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:40.053147 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 155/308] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:47:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:40.053936 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db45f1-a522-4bad-a5c9-6bf7ea341a6c None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:40.118529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 154/309] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:40.120090 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3e095-3aa8-4451-8d2c-d9e7dd53757d None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:40.159383 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db45f1-a522-4bad-a5c9-6bf7ea341a6c None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:40.183299 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:40.195878 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d230b0-2c71-48d2-afa7-3872ecb912e2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZXPntzRDTLeUPa-KSXY4wQ, audit_chain_id=['ZXPntzRDTLeUPa-KSXY4wQ']) at 0x7f8a142fa700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:40.197009 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d230b0-2c71-48d2-afa7-3872ecb912e2 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:40.197009 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d230b0-2c71-48d2-afa7-3872ecb912e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:40.197534 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d230b0-2c71-48d2-afa7-3872ecb912e2 None admin] PATH_INFO: `/v3/users/21d8dd2b53fd4bdd90f99889c4112e0f` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:40.213261 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d230b0-2c71-48d2-afa7-3872ecb912e2 None admin] RBAC: Authorizing `identity:get_user(user_id=21d8dd2b53fd4bdd90f99889c4112e0f)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:40.214899 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d230b0-2c71-48d2-afa7-3872ecb912e2 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:40.217370 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 156/310] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:40 2022] GET /identity/v3/users/21d8dd2b53fd4bdd90f99889c4112e0f => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:40.222486 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d230b0-2c71-48d2-afa7-3872ecb912e2 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:40.251244 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3e095-3aa8-4451-8d2c-d9e7dd53757d None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:40.284528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:40.290277 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3897eeb-e1a2-43e1-9961-14f947aa80b6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=JvcQa--xTkKmji0VpR7N2g, audit_chain_id=['JvcQa--xTkKmji0VpR7N2g']) at 0x7f8a0fe70280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:40.290912 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3897eeb-e1a2-43e1-9961-14f947aa80b6 None admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:40.291238 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3897eeb-e1a2-43e1-9961-14f947aa80b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:40.291463 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3897eeb-e1a2-43e1-9961-14f947aa80b6 None admin] PATH_INFO: `/v3/groups` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:40.292130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3897eeb-e1a2-43e1-9961-14f947aa80b6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:40.293565 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3897eeb-e1a2-43e1-9961-14f947aa80b6 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:40.308992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 155/311] 10.222.0.47 () {60 vars in 1134 bytes} [Mon Jul 25 22:47:40 2022] POST /identity/v3/groups => generated 229 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:47:40.310395 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3897eeb-e1a2-43e1-9961-14f947aa80b6 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:40.349249 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d230b0-2c71-48d2-afa7-3872ecb912e2 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:40.390835 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5a224-914f-427d-9940-cfb5d9de8633 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qS8nK26uSgO0_UPp8_ddAg, audit_chain_id=['qS8nK26uSgO0_UPp8_ddAg']) at 0x7f8a0fdd2370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:40.391675 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5a224-914f-427d-9940-cfb5d9de8633 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:40.391960 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5a224-914f-427d-9940-cfb5d9de8633 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:40.392244 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5a224-914f-427d-9940-cfb5d9de8633 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:40.405404 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5a224-914f-427d-9940-cfb5d9de8633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:40.411182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-e5f5a224-914f-427d-9940-cfb5d9de8633 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:47:40.411182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:40.411182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:40.411182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:40.411182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:40.411182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:40.411182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:40.411182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:40.411182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:40.411182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:40.411182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:40.411182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:40.411182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:40.411182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:40.411182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:40.411182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:40.412148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:40.412148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:40.412148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:40.412148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:40.412148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:40.412148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:40.412148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:40.412148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:40.412148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:40.412148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:40.412148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:40.412148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:40.412148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:40.412148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:40.412148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:40.412148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:40.412945 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:40.412945 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:40.412945 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:40.412945 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:40.412945 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:40.412945 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:40.412945 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:40.412945 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:40.412945 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:40.412945 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:40.412945 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:47:40.412945 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:47:40.412945 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 157/312] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:40.419170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5a224-914f-427d-9940-cfb5d9de8633 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:40.469877 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3897eeb-e1a2-43e1-9961-14f947aa80b6 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:40.483520 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:40.521064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa915a2-90b9-49b2-b736-7125748cfd78 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZXPntzRDTLeUPa-KSXY4wQ, audit_chain_id=['ZXPntzRDTLeUPa-KSXY4wQ']) at 0x7f8a0fe471c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:40.521910 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa915a2-90b9-49b2-b736-7125748cfd78 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:40.522300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa915a2-90b9-49b2-b736-7125748cfd78 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:40.522682 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa915a2-90b9-49b2-b736-7125748cfd78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:40.523709 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa915a2-90b9-49b2-b736-7125748cfd78 None admin] RBAC: Adding query filter params (role.id=862b3fa9d6834bd3b14681fc489500a7, user.id=21d8dd2b53fd4bdd90f99889c4112e0f, scope.system=all) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:40.524123 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa915a2-90b9-49b2-b736-7125748cfd78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:40.526365 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa915a2-90b9-49b2-b736-7125748cfd78 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:40.533481 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 156/313] 10.222.0.47 () {56 vars in 1308 bytes} [Mon Jul 25 22:47:40 2022] GET /identity/v3/role_assignments?user.id=21d8dd2b53fd4bdd90f99889c4112e0f&scope.system=all&role.id=862b3fa9d6834bd3b14681fc489500a7 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:40.566248 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5a224-914f-427d-9940-cfb5d9de8633 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:40.610371 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa757b-d66a-4c1e-b632-b61901488343 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qS8nK26uSgO0_UPp8_ddAg, audit_chain_id=['qS8nK26uSgO0_UPp8_ddAg']) at 0x7f8a0fe071c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:40.611264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa757b-d66a-4c1e-b632-b61901488343 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:40.611545 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa757b-d66a-4c1e-b632-b61901488343 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:40.611817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa757b-d66a-4c1e-b632-b61901488343 None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:40.612543 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa757b-d66a-4c1e-b632-b61901488343 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:40.612845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa757b-d66a-4c1e-b632-b61901488343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:40.614401 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa757b-d66a-4c1e-b632-b61901488343 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:40.627490 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 158/314] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:40.633819 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa915a2-90b9-49b2-b736-7125748cfd78 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:40.702435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:40.753132 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa915a2-90b9-49b2-b736-7125748cfd78 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:40.790751 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5c1e5-d0d4-4c15-b2bb-6cfd015a99b0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qS8nK26uSgO0_UPp8_ddAg, audit_chain_id=['qS8nK26uSgO0_UPp8_ddAg']) at 0x7f8a1412fb50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:40.791768 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5c1e5-d0d4-4c15-b2bb-6cfd015a99b0 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:40.792461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5c1e5-d0d4-4c15-b2bb-6cfd015a99b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:40.792963 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5c1e5-d0d4-4c15-b2bb-6cfd015a99b0 None admin] PATH_INFO: `/v3/users/78c270a1d38c4e16984fd4c6afb48739` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:40.794430 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5c1e5-d0d4-4c15-b2bb-6cfd015a99b0 None admin] RBAC: Authorizing `identity:get_user(user_id=78c270a1d38c4e16984fd4c6afb48739)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:40.796258 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5c1e5-d0d4-4c15-b2bb-6cfd015a99b0 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:40.798142 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 157/315] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:40 2022] GET /identity/v3/users/78c270a1d38c4e16984fd4c6afb48739 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:40.804015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa757b-d66a-4c1e-b632-b61901488343 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:40.917396 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa757b-d66a-4c1e-b632-b61901488343 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:40.920179 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:40.955332 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e738a50-5c6e-4b94-8249-39ee905e76cc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qS8nK26uSgO0_UPp8_ddAg, audit_chain_id=['qS8nK26uSgO0_UPp8_ddAg']) at 0x7f8a142c7eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:40.956281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e738a50-5c6e-4b94-8249-39ee905e76cc None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:40.956764 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e738a50-5c6e-4b94-8249-39ee905e76cc None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:40.957253 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e738a50-5c6e-4b94-8249-39ee905e76cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:41.033932 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e738a50-5c6e-4b94-8249-39ee905e76cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:41.035401 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e738a50-5c6e-4b94-8249-39ee905e76cc None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:41.140189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 159/316] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:41.146096 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5c1e5-d0d4-4c15-b2bb-6cfd015a99b0 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:41.257559 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5c1e5-d0d4-4c15-b2bb-6cfd015a99b0 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:41.283642 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:41.296101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce78fec-61ca-4c87-a995-a0d502bdb9b6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qS8nK26uSgO0_UPp8_ddAg, audit_chain_id=['qS8nK26uSgO0_UPp8_ddAg']) at 0x7f8a1412c9d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:41.296765 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce78fec-61ca-4c87-a995-a0d502bdb9b6 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:41.297049 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce78fec-61ca-4c87-a995-a0d502bdb9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:41.297324 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce78fec-61ca-4c87-a995-a0d502bdb9b6 None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:41.298537 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce78fec-61ca-4c87-a995-a0d502bdb9b6 None admin] RBAC: Authorizing `identity:get_project(project_id=fa144b85a37b4dd191df360058c783d1)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:41.299995 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce78fec-61ca-4c87-a995-a0d502bdb9b6 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:41.301667 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 158/317] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:41 2022] GET /identity/v3/projects/fa144b85a37b4dd191df360058c783d1 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:41.307844 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e738a50-5c6e-4b94-8249-39ee905e76cc None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:41.327569 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:41.411692 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e738a50-5c6e-4b94-8249-39ee905e76cc None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:41.446302 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9061a-4760-417f-9b8d-7736ba6168a6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qS8nK26uSgO0_UPp8_ddAg, audit_chain_id=['qS8nK26uSgO0_UPp8_ddAg']) at 0x7f8a0fe94130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:41.446921 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9061a-4760-417f-9b8d-7736ba6168a6 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:41.447204 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9061a-4760-417f-9b8d-7736ba6168a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:41.447481 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9061a-4760-417f-9b8d-7736ba6168a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:41.448270 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9061a-4760-417f-9b8d-7736ba6168a6 None admin] RBAC: Adding query filter params (role.id=862b3fa9d6834bd3b14681fc489500a7, scope.project.id=fa144b85a37b4dd191df360058c783d1, user.id=78c270a1d38c4e16984fd4c6afb48739) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:41.448581 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9061a-4760-417f-9b8d-7736ba6168a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:41.450610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9061a-4760-417f-9b8d-7736ba6168a6 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:41.457552 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 160/318] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:47:41 2022] GET /identity/v3/role_assignments?user.id=78c270a1d38c4e16984fd4c6afb48739&scope.project.id=fa144b85a37b4dd191df360058c783d1&role.id=862b3fa9d6834bd3b14681fc489500a7 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:42.128003 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6a002-abda-42ad-aeed-c8cc85b3f247 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:42.128308 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6a002-abda-42ad-aeed-c8cc85b3f247 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:42.128679 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6a002-abda-42ad-aeed-c8cc85b3f247 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:42.130117 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 159/319] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:42.135375 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c7835-6c36-4c09-9050-b5b14a15d735 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:42.135730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c7835-6c36-4c09-9050-b5b14a15d735 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:42.136057 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c7835-6c36-4c09-9050-b5b14a15d735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:42.156423 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-530c7835-6c36-4c09-9050-b5b14a15d735 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:42.157617 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-530c7835-6c36-4c09-9050-b5b14a15d735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:42.224031 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:42.233632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 161/320] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:47:42.255650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6a002-abda-42ad-aeed-c8cc85b3f247 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:42.362581 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6a002-abda-42ad-aeed-c8cc85b3f247 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:42.397289 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19fc47-a53a-4e1a-b431-30d415827544 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2NVqGT1yTDS9KNnPIBMDhA, audit_chain_id=['2NVqGT1yTDS9KNnPIBMDhA']) at 0x7f8a141766d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:42.397906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19fc47-a53a-4e1a-b431-30d415827544 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:42.398195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19fc47-a53a-4e1a-b431-30d415827544 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:42.398474 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19fc47-a53a-4e1a-b431-30d415827544 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:42.409509 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19fc47-a53a-4e1a-b431-30d415827544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:42.414952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-de19fc47-a53a-4e1a-b431-30d415827544 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:42.414952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:42.414952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:42.414952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:42.414952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:42.414952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:42.414952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:42.414952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:42.414952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:42.414952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:42.414952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:42.414952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:42.414952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:42.414952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:42.414952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:42.414952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:42.415878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:42.415878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:42.415878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:42.415878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:42.415878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:42.415878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:42.415878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:42.415878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:42.415878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:42.415878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:42.415878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:42.415878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:42.415878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:42.415878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:42.415878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:42.415878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:42.416691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:42.416691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:42.416691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:42.416691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:42.416691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:42.416691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:42.416691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:42.416691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:42.416691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:42.416691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:42.416691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:42.416691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:42.418022 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 160/321] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:42.421978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c7835-6c36-4c09-9050-b5b14a15d735 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:42.549811 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c7835-6c36-4c09-9050-b5b14a15d735 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:42.584173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd27351-818e-4226-92ab-e5d5ab8490ae None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2NVqGT1yTDS9KNnPIBMDhA, audit_chain_id=['2NVqGT1yTDS9KNnPIBMDhA']) at 0x7f8a0fe25be0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:42.584800 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd27351-818e-4226-92ab-e5d5ab8490ae None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:42.585084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd27351-818e-4226-92ab-e5d5ab8490ae None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:42.585369 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd27351-818e-4226-92ab-e5d5ab8490ae None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:42.586120 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd27351-818e-4226-92ab-e5d5ab8490ae None admin] RBAC: Adding query filter params (name=member) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:42.586430 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd27351-818e-4226-92ab-e5d5ab8490ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:42.587805 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd27351-818e-4226-92ab-e5d5ab8490ae None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:42.601651 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 162/322] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:42.602924 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19fc47-a53a-4e1a-b431-30d415827544 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:42.664255 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:42.716915 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19fc47-a53a-4e1a-b431-30d415827544 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:42.750494 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055706ef-ca1e-4a60-8207-18d2e84f296c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2NVqGT1yTDS9KNnPIBMDhA, audit_chain_id=['2NVqGT1yTDS9KNnPIBMDhA']) at 0x7f8a0fe42eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:42.751148 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055706ef-ca1e-4a60-8207-18d2e84f296c None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:42.751433 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055706ef-ca1e-4a60-8207-18d2e84f296c None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:42.751713 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055706ef-ca1e-4a60-8207-18d2e84f296c None admin] PATH_INFO: `/v3/users/4356fb7a7b6244a5bf9fabdf4a053a6d` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:42.752908 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055706ef-ca1e-4a60-8207-18d2e84f296c None admin] RBAC: Authorizing `identity:get_user(user_id=4356fb7a7b6244a5bf9fabdf4a053a6d)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:42.754392 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055706ef-ca1e-4a60-8207-18d2e84f296c None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:42.760815 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 161/323] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:42 2022] GET /identity/v3/users/4356fb7a7b6244a5bf9fabdf4a053a6d => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:42.762248 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055706ef-ca1e-4a60-8207-18d2e84f296c None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:42.762389 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afbc7e-d53a-498b-8056-e786671f9e50 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:42.763156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afbc7e-d53a-498b-8056-e786671f9e50 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:42.763598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afbc7e-d53a-498b-8056-e786671f9e50 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:42.765060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 163/324] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:42.770167 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474d820-8622-4334-bf1b-67ea2f15edc0 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:42.770461 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474d820-8622-4334-bf1b-67ea2f15edc0 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:42.770747 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474d820-8622-4334-bf1b-67ea2f15edc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:42.790089 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-0474d820-8622-4334-bf1b-67ea2f15edc0 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:42.791403 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-0474d820-8622-4334-bf1b-67ea2f15edc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:42.849771 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:42.862106 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 164/325] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:47:42.864534 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd12dc2-436d-4f51-bcb4-f7d59032ece2 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:42.864823 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd12dc2-436d-4f51-bcb4-f7d59032ece2 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:42.865098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd12dc2-436d-4f51-bcb4-f7d59032ece2 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:42.866509 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 165/326] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:42.871743 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a96caa-2ed0-4bec-86c2-fe973c2288da None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:42.872808 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a96caa-2ed0-4bec-86c2-fe973c2288da None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:42.873049 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055706ef-ca1e-4a60-8207-18d2e84f296c None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:42.873156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a96caa-2ed0-4bec-86c2-fe973c2288da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:42.892973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-a2a96caa-2ed0-4bec-86c2-fe973c2288da None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:42.894171 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-a2a96caa-2ed0-4bec-86c2-fe973c2288da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:42.895568 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:42.910979 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c5f57-eaaa-49aa-89ef-a765fb2736f0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2NVqGT1yTDS9KNnPIBMDhA, audit_chain_id=['2NVqGT1yTDS9KNnPIBMDhA']) at 0x7f8a0fd85310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:42.911602 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c5f57-eaaa-49aa-89ef-a765fb2736f0 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:42.911884 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c5f57-eaaa-49aa-89ef-a765fb2736f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:42.912217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c5f57-eaaa-49aa-89ef-a765fb2736f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:42.912997 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c5f57-eaaa-49aa-89ef-a765fb2736f0 None admin] RBAC: Adding query filter params (role.id=c57f45d724fe45009701c9b2706d661c, user.id=4356fb7a7b6244a5bf9fabdf4a053a6d, scope.system=all) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:42.913308 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c5f57-eaaa-49aa-89ef-a765fb2736f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:42.914847 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c5f57-eaaa-49aa-89ef-a765fb2736f0 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:42.927060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 162/327] 10.222.0.47 () {56 vars in 1308 bytes} [Mon Jul 25 22:47:42 2022] GET /identity/v3/role_assignments?user.id=4356fb7a7b6244a5bf9fabdf4a053a6d&scope.system=all&role.id=c57f45d724fe45009701c9b2706d661c => generated 510 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:42.928070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c5f57-eaaa-49aa-89ef-a765fb2736f0 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:42.973605 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 166/328] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:47:42.987949 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a96caa-2ed0-4bec-86c2-fe973c2288da None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:43.056011 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c5f57-eaaa-49aa-89ef-a765fb2736f0 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:43.092194 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a96caa-2ed0-4bec-86c2-fe973c2288da None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:43.097336 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7956b4-ce45-432c-8c24-02cfe9be6446 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7ExvdSSSRcuQ9fe8t_yUWA, audit_chain_id=['7ExvdSSSRcuQ9fe8t_yUWA']) at 0x7f8a141288e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:43.098253 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7956b4-ce45-432c-8c24-02cfe9be6446 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:43.098748 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7956b4-ce45-432c-8c24-02cfe9be6446 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:43.099213 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7956b4-ce45-432c-8c24-02cfe9be6446 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:43.100692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7956b4-ce45-432c-8c24-02cfe9be6446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:43.102408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7956b4-ce45-432c-8c24-02cfe9be6446 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:43.104015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 163/329] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:47:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:43.110369 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7956b4-ce45-432c-8c24-02cfe9be6446 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:43.116160 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:43.137911 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd5e4c-79fc-431e-b745-9431aace6e0b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=maCrUSRXRBuw_679Ws6nMA, audit_chain_id=['maCrUSRXRBuw_679Ws6nMA']) at 0x7f8a0fdc4070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:43.139545 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd5e4c-79fc-431e-b745-9431aace6e0b None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:43.139545 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd5e4c-79fc-431e-b745-9431aace6e0b None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:43.139545 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd5e4c-79fc-431e-b745-9431aace6e0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:43.160411 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd5e4c-79fc-431e-b745-9431aace6e0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:43.163216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-e3fd5e4c-79fc-431e-b745-9431aace6e0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:47:43.163216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:43.163216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:43.163216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:43.163216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:43.163216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:43.163216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:43.163216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:43.163216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:43.163216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:43.163216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:43.163216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:43.163216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:43.163216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:43.163216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:43.163216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:43.164129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:43.164129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:43.164129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:43.164129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:43.164129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:43.164129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:43.164129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:43.164129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:43.164129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:43.164129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:43.164129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:43.164129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:43.164129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:43.164129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:43.164129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:43.164129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:43.164994 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:43.164994 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:43.164994 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:43.164994 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:43.164994 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:43.164994 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:43.164994 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:43.164994 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:43.164994 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:43.164994 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:43.164994 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:47:43.164994 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:47:43.164994 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 167/330] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:47:43.170403 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:43.170914 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd5e4c-79fc-431e-b745-9431aace6e0b None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:43.226562 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7956b4-ce45-432c-8c24-02cfe9be6446 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:43.260291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5eeeff-df5f-4e8a-8344-3e785c36b0a0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7ExvdSSSRcuQ9fe8t_yUWA, audit_chain_id=['7ExvdSSSRcuQ9fe8t_yUWA']) at 0x7f8a0fe2a4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:43.260934 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eeeff-df5f-4e8a-8344-3e785c36b0a0 None admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:43.261192 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eeeff-df5f-4e8a-8344-3e785c36b0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:43.261471 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eeeff-df5f-4e8a-8344-3e785c36b0a0 None admin] PATH_INFO: `/v3/groups` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:43.262165 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5eeeff-df5f-4e8a-8344-3e785c36b0a0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:43.263872 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5eeeff-df5f-4e8a-8344-3e785c36b0a0 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:43.272863 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd5e4c-79fc-431e-b745-9431aace6e0b None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:43.279408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 164/331] 10.222.0.47 () {60 vars in 1134 bytes} [Mon Jul 25 22:47:43 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:47:43.310111 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db771f65-7305-4dca-bad1-5c2d5636617a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=maCrUSRXRBuw_679Ws6nMA, audit_chain_id=['maCrUSRXRBuw_679Ws6nMA']) at 0x7f8a0fe14640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:43.310467 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db771f65-7305-4dca-bad1-5c2d5636617a None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:43.310651 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db771f65-7305-4dca-bad1-5c2d5636617a None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:43.310929 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db771f65-7305-4dca-bad1-5c2d5636617a None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:43.311668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db771f65-7305-4dca-bad1-5c2d5636617a None admin] RBAC: Adding query filter params (name=reader) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:43.311977 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db771f65-7305-4dca-bad1-5c2d5636617a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:43.313390 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db771f65-7305-4dca-bad1-5c2d5636617a None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:43.322843 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 168/332] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:43.328566 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5eeeff-df5f-4e8a-8344-3e785c36b0a0 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:43.437375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5eeeff-df5f-4e8a-8344-3e785c36b0a0 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:43.444614 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:43.478446 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d03173-3347-4a41-87d6-4473a0f89dad None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=maCrUSRXRBuw_679Ws6nMA, audit_chain_id=['maCrUSRXRBuw_679Ws6nMA']) at 0x7f8a1419c070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:43.478983 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d03173-3347-4a41-87d6-4473a0f89dad None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:43.479269 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d03173-3347-4a41-87d6-4473a0f89dad None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:43.479547 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d03173-3347-4a41-87d6-4473a0f89dad None admin] PATH_INFO: `/v3/users/21d8dd2b53fd4bdd90f99889c4112e0f` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:43.480836 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d03173-3347-4a41-87d6-4473a0f89dad None admin] RBAC: Authorizing `identity:get_user(user_id=21d8dd2b53fd4bdd90f99889c4112e0f)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:43.482564 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d03173-3347-4a41-87d6-4473a0f89dad None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:43.484202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 165/333] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:43 2022] GET /identity/v3/users/21d8dd2b53fd4bdd90f99889c4112e0f => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:43.490030 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db771f65-7305-4dca-bad1-5c2d5636617a None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:43.535415 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:43.600524 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db771f65-7305-4dca-bad1-5c2d5636617a None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:43.638138 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefd769-b3b0-4793-a120-c325b4960f27 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=maCrUSRXRBuw_679Ws6nMA, audit_chain_id=['maCrUSRXRBuw_679Ws6nMA']) at 0x7f8a0fee1b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:43.638818 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefd769-b3b0-4793-a120-c325b4960f27 None admin] REQUEST_METHOD: `PUT` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:43.639097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefd769-b3b0-4793-a120-c325b4960f27 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:43.639380 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefd769-b3b0-4793-a120-c325b4960f27 None admin] PATH_INFO: `/v3/system/users/21d8dd2b53fd4bdd90f99889c4112e0f/roles/862b3fa9d6834bd3b14681fc489500a7` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:43.640887 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefd769-b3b0-4793-a120-c325b4960f27 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=21d8dd2b53fd4bdd90f99889c4112e0f, role_id=862b3fa9d6834bd3b14681fc489500a7)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:43.642587 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefd769-b3b0-4793-a120-c325b4960f27 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:43.650550 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 169/334] 10.222.0.47 () {58 vars in 1334 bytes} [Mon Jul 25 22:47:43 2022] PUT /identity/v3/system/users/21d8dd2b53fd4bdd90f99889c4112e0f/roles/862b3fa9d6834bd3b14681fc489500a7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:47:46.385436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513be316-3e49-4381-84a8-f94d4b116bf3 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:46.386573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513be316-3e49-4381-84a8-f94d4b116bf3 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:46.387065 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513be316-3e49-4381-84a8-f94d4b116bf3 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:46.389622 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 166/335] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:46.391691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd8dcd-4592-492a-aea0-ec21d7a5007b None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:46.392520 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd8dcd-4592-492a-aea0-ec21d7a5007b None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:46.393000 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd8dcd-4592-492a-aea0-ec21d7a5007b None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:46.394799 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b046e-3f4b-4d79-99e3-4792d9a71289 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:46.395313 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b046e-3f4b-4d79-99e3-4792d9a71289 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:46.395805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b046e-3f4b-4d79-99e3-4792d9a71289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:46.406552 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 170/336] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:46 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:46.411629 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49066ba0-5db4-4cc8-9120-42bd6a609437 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:46.417324 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49066ba0-5db4-4cc8-9120-42bd6a609437 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:46.417904 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49066ba0-5db4-4cc8-9120-42bd6a609437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:46.434702 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-210b046e-3f4b-4d79-99e3-4792d9a71289 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:46.437060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-210b046e-3f4b-4d79-99e3-4792d9a71289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:46.458231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-49066ba0-5db4-4cc8-9120-42bd6a609437 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:46.461272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-49066ba0-5db4-4cc8-9120-42bd6a609437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:46.614222 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 167/337] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:46.634431 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 171/338] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:46.654872 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef94c6a-376c-4037-a7cb-9487e7fd9917 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:46.655146 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef94c6a-376c-4037-a7cb-9487e7fd9917 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:46.655367 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef94c6a-376c-4037-a7cb-9487e7fd9917 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:46.656987 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 168/339] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:47:46.662556 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef94c6a-376c-4037-a7cb-9487e7fd9917 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:46.673386 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb40377-be92-4ceb-8721-9afe0206848c None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:46.673708 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb40377-be92-4ceb-8721-9afe0206848c None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:46.673995 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb40377-be92-4ceb-8721-9afe0206848c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:46.701959 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-aeb40377-be92-4ceb-8721-9afe0206848c None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:46.703577 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-aeb40377-be92-4ceb-8721-9afe0206848c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:46.743716 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:46.789258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 172/340] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:46.800092 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb40377-be92-4ceb-8721-9afe0206848c None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:46.883579 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef94c6a-376c-4037-a7cb-9487e7fd9917 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:46.888847 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:46.944912 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a233d4-3c9b-48ab-9329-ebdedb3c1274 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-VG3CU1qTkGdjraXV6CZxA, audit_chain_id=['-VG3CU1qTkGdjraXV6CZxA']) at 0x7f8a14186ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:46.945653 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a233d4-3c9b-48ab-9329-ebdedb3c1274 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:46.946013 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a233d4-3c9b-48ab-9329-ebdedb3c1274 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:46.946624 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a233d4-3c9b-48ab-9329-ebdedb3c1274 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:46.951109 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb40377-be92-4ceb-8721-9afe0206848c None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:46.959951 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a233d4-3c9b-48ab-9329-ebdedb3c1274 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:46.967956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-18a233d4-3c9b-48ab-9329-ebdedb3c1274 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:46.967956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:46.967956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:46.967956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:46.967956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:46.967956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:46.967956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:46.967956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:46.967956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:46.967956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:46.967956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:46.967956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:46.967956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:46.967956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:46.967956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:46.967956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:46.968861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:46.968861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:46.968861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:46.968861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:46.968861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:46.968861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:46.968861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:46.968861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:46.968861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:46.968861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:46.968861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:46.968861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:46.968861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:46.968861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:46.968861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:46.968861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:46.969698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:46.969698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:46.969698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:46.969698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:46.969698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:46.969698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:46.969698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:46.969698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:46.969698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:46.969698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:46.969698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:46.969698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:46.969698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 169/341] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:47:46.970371 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010ccb-bfdf-4f63-946f-5325c22217b0 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:46.971223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010ccb-bfdf-4f63-946f-5325c22217b0 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:46.971825 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65010ccb-bfdf-4f63-946f-5325c22217b0 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:46.978168 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 170/342] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:46.979132 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65010ccb-bfdf-4f63-946f-5325c22217b0 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:47.004976 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe6db1-ffd4-4bd9-a384-1cb28db26a5e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1tun7R0GQY-9CJ81FqbJIA, audit_chain_id=['1tun7R0GQY-9CJ81FqbJIA']) at 0x7f8a143614c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:47.006459 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe6db1-ffd4-4bd9-a384-1cb28db26a5e None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:47.006459 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe6db1-ffd4-4bd9-a384-1cb28db26a5e None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:47.006459 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe6db1-ffd4-4bd9-a384-1cb28db26a5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:47.018454 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe6db1-ffd4-4bd9-a384-1cb28db26a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:47.024074 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-9cbe6db1-ffd4-4bd9-a384-1cb28db26a5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:47.024074 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:47.024074 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:47.024074 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:47.024074 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:47.024074 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:47.024074 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:47.024074 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:47.024074 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:47.024074 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:47.024074 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:47.024074 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:47.024074 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:47.024074 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:47.024074 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:47.024074 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:47.024940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:47.024940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:47.024940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:47.024940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:47.024940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:47.024940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:47.024940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:47.024940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:47.024940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:47.024940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:47.024940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:47.024940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:47.024940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:47.024940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:47.024940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:47.024940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:47.025789 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:47.025789 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:47.025789 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:47.025789 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:47.025789 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:47.025789 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:47.025789 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:47.025789 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:47.025789 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:47.025789 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:47.025789 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:47.025789 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:47:47.025789 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 173/343] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:47.028601 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4f70e-29f7-4179-9324-275aea378633 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:47.028601 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4f70e-29f7-4179-9324-275aea378633 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:47.028601 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4f70e-29f7-4179-9324-275aea378633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:47.049728 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-44e4f70e-29f7-4179-9324-275aea378633 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:47.052455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-44e4f70e-29f7-4179-9324-275aea378633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:47.074164 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:47.107137 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65010ccb-bfdf-4f63-946f-5325c22217b0 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:47.134079 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 174/344] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:47.134924 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4f70e-29f7-4179-9324-275aea378633 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:47.149746 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf181016-c0a7-4ece-a5de-de2cadb4e696 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZXjO5oADSuODnBi0B6d5Mw, audit_chain_id=['ZXjO5oADSuODnBi0B6d5Mw']) at 0x7f8a0fe42400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:47.150756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf181016-c0a7-4ece-a5de-de2cadb4e696 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:47.151245 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf181016-c0a7-4ece-a5de-de2cadb4e696 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:47.151775 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf181016-c0a7-4ece-a5de-de2cadb4e696 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:47.166133 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf181016-c0a7-4ece-a5de-de2cadb4e696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:47.172598 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-cf181016-c0a7-4ece-a5de-de2cadb4e696 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:47.172598 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:47.172598 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:47.172598 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:47.172598 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:47.172598 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:47.172598 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:47.172598 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:47.172598 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:47.172598 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:47.172598 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:47.172598 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:47.172598 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:47.172598 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:47.172598 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:47.172598 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:47.173659 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:47.173659 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:47.173659 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:47.173659 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:47.173659 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:47.173659 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:47.173659 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:47.173659 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:47.173659 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:47.173659 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:47.173659 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:47.173659 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:47.173659 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:47.173659 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:47.173659 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:47.173659 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:47.174495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:47.174495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:47.174495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:47.174495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:47.174495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:47.174495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:47.174495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:47.174495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:47.174495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:47.174495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:47.174495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:47.174495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:47.177524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 171/345] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:47:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:47.178676 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf181016-c0a7-4ece-a5de-de2cadb4e696 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:47.208963 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:47.274140 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4f70e-29f7-4179-9324-275aea378633 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:47.291580 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf181016-c0a7-4ece-a5de-de2cadb4e696 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:47.313448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d61788-eced-4737-ba8f-2883fd613da7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-VG3CU1qTkGdjraXV6CZxA, audit_chain_id=['-VG3CU1qTkGdjraXV6CZxA']) at 0x7f8a0fe14ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:47.314112 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d61788-eced-4737-ba8f-2883fd613da7 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:47.314439 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d61788-eced-4737-ba8f-2883fd613da7 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:47.314726 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d61788-eced-4737-ba8f-2883fd613da7 None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:47.315452 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d61788-eced-4737-ba8f-2883fd613da7 None admin] RBAC: Adding query filter params (name=member) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:47.315757 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d61788-eced-4737-ba8f-2883fd613da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:47.317254 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d61788-eced-4737-ba8f-2883fd613da7 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:47.326396 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 175/346] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:47.327222 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d61788-eced-4737-ba8f-2883fd613da7 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:47.333512 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a566a-2691-4fff-aabe-3d9db082ff75 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1tun7R0GQY-9CJ81FqbJIA, audit_chain_id=['1tun7R0GQY-9CJ81FqbJIA']) at 0x7f8a0fe6aca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:47.334390 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a566a-2691-4fff-aabe-3d9db082ff75 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:47.334821 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a566a-2691-4fff-aabe-3d9db082ff75 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:47.335241 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a566a-2691-4fff-aabe-3d9db082ff75 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:47.336114 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a566a-2691-4fff-aabe-3d9db082ff75 None admin] RBAC: Adding query filter params (name=member) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:47.336570 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a566a-2691-4fff-aabe-3d9db082ff75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:47.338152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a566a-2691-4fff-aabe-3d9db082ff75 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:47.347651 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 172/347] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:47.348940 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a566a-2691-4fff-aabe-3d9db082ff75 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:47.359124 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:47.464204 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:47.471822 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d61788-eced-4737-ba8f-2883fd613da7 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:47.488827 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a566a-2691-4fff-aabe-3d9db082ff75 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:47.517727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6c878-9896-4cb3-94d2-e32678b0cb89 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZXjO5oADSuODnBi0B6d5Mw, audit_chain_id=['ZXjO5oADSuODnBi0B6d5Mw']) at 0x7f8a0fe7f130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:47.518354 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6c878-9896-4cb3-94d2-e32678b0cb89 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:47.518901 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6c878-9896-4cb3-94d2-e32678b0cb89 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:47.519431 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6c878-9896-4cb3-94d2-e32678b0cb89 None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:47.520399 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6c878-9896-4cb3-94d2-e32678b0cb89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:47.520861 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6c878-9896-4cb3-94d2-e32678b0cb89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:47.522501 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6c878-9896-4cb3-94d2-e32678b0cb89 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:47.529406 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014755c6-b927-4076-b6a3-6a9f5d217045 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WlACNhdeRouppkKVHtR4Xg, audit_chain_id=['WlACNhdeRouppkKVHtR4Xg']) at 0x7f8a1419a850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:47.531253 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014755c6-b927-4076-b6a3-6a9f5d217045 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:47.531765 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014755c6-b927-4076-b6a3-6a9f5d217045 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:47.532241 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014755c6-b927-4076-b6a3-6a9f5d217045 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:47.533395 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 176/348] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:47:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:47.534272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6c878-9896-4cb3-94d2-e32678b0cb89 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:47.550090 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014755c6-b927-4076-b6a3-6a9f5d217045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:47.554789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-014755c6-b927-4076-b6a3-6a9f5d217045 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:47:47.554789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:47.554789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:47.554789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:47.554789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:47.554789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:47.554789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:47.554789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:47.554789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:47.554789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:47.554789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:47.554789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:47.554789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:47.554789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:47.554789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:47.554789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:47.555727 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:47.555727 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:47.555727 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:47.555727 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:47.555727 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:47.555727 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:47.555727 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:47.555727 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:47.555727 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:47.555727 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:47.555727 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:47.555727 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:47.555727 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:47.555727 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:47.555727 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:47.555727 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:47.556521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:47.556521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:47.556521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:47.556521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:47.556521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:47.556521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:47.556521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:47.556521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:47.556521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:47.556521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:47.556521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:47:47.556521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:47.558488 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 173/349] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:47.560506 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06876d-7df7-473a-8cc2-9fbbebbbedd2 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:47.560973 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06876d-7df7-473a-8cc2-9fbbebbbedd2 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:47.561395 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06876d-7df7-473a-8cc2-9fbbebbbedd2 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:47.562915 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 174/350] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:47.563780 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06876d-7df7-473a-8cc2-9fbbebbbedd2 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:47.640116 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:47.667749 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6c878-9896-4cb3-94d2-e32678b0cb89 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:47.700670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06876d-7df7-473a-8cc2-9fbbebbbedd2 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:47.716707 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55918ee3-9e04-4801-8bf7-64c994cb528b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-VG3CU1qTkGdjraXV6CZxA, audit_chain_id=['-VG3CU1qTkGdjraXV6CZxA']) at 0x7f8a0fee17c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:47.717034 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55918ee3-9e04-4801-8bf7-64c994cb528b None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:47.717319 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55918ee3-9e04-4801-8bf7-64c994cb528b None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:47.720366 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55918ee3-9e04-4801-8bf7-64c994cb528b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:47.748291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00031e1-e9b3-44d0-901e-c60dc4e89c1b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1tun7R0GQY-9CJ81FqbJIA, audit_chain_id=['1tun7R0GQY-9CJ81FqbJIA']) at 0x7f8a0fe3f370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:47.748924 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00031e1-e9b3-44d0-901e-c60dc4e89c1b None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:47.749211 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00031e1-e9b3-44d0-901e-c60dc4e89c1b None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:47.749477 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00031e1-e9b3-44d0-901e-c60dc4e89c1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:47.769992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:47.821614 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55918ee3-9e04-4801-8bf7-64c994cb528b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:47.823775 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55918ee3-9e04-4801-8bf7-64c994cb528b None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:47.856853 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00031e1-e9b3-44d0-901e-c60dc4e89c1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:47.859214 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00031e1-e9b3-44d0-901e-c60dc4e89c1b None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:47.948588 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:47.973445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 177/351] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:47.974344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55918ee3-9e04-4801-8bf7-64c994cb528b None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:48.007860 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 175/352] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:48.009425 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0646d1d-3781-4a0d-ab9a-a4aa76fed76b None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:48.009741 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0646d1d-3781-4a0d-ab9a-a4aa76fed76b None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:48.010327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0646d1d-3781-4a0d-ab9a-a4aa76fed76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:48.031924 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-b0646d1d-3781-4a0d-ab9a-a4aa76fed76b None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:48.033268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-b0646d1d-3781-4a0d-ab9a-a4aa76fed76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:48.085572 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:48.097720 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55918ee3-9e04-4801-8bf7-64c994cb528b None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:48.117549 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 176/353] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:48.118303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0646d1d-3781-4a0d-ab9a-a4aa76fed76b None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:48.145386 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e248e5-8193-4cb0-9f85-007281aa10a0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZXjO5oADSuODnBi0B6d5Mw, audit_chain_id=['ZXjO5oADSuODnBi0B6d5Mw']) at 0x7f8a0fdce7c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:48.146514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e248e5-8193-4cb0-9f85-007281aa10a0 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:48.146621 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e248e5-8193-4cb0-9f85-007281aa10a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:48.147060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e248e5-8193-4cb0-9f85-007281aa10a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:48.202872 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:48.227408 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e248e5-8193-4cb0-9f85-007281aa10a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:48.228796 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e248e5-8193-4cb0-9f85-007281aa10a0 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:48.236495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0646d1d-3781-4a0d-ab9a-a4aa76fed76b None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:48.280006 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930fc70-e890-4b56-9c1b-b9a5250a4f31 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WlACNhdeRouppkKVHtR4Xg, audit_chain_id=['WlACNhdeRouppkKVHtR4Xg']) at 0x7f8a0fffca60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:48.280940 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930fc70-e890-4b56-9c1b-b9a5250a4f31 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:48.281287 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930fc70-e890-4b56-9c1b-b9a5250a4f31 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:48.281521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930fc70-e890-4b56-9c1b-b9a5250a4f31 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:48.282463 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930fc70-e890-4b56-9c1b-b9a5250a4f31 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:48.282774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930fc70-e890-4b56-9c1b-b9a5250a4f31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:48.284157 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930fc70-e890-4b56-9c1b-b9a5250a4f31 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:48.293102 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 177/354] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:48.294080 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930fc70-e890-4b56-9c1b-b9a5250a4f31 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:48.345142 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:48.351134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 178/355] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:48.351134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e248e5-8193-4cb0-9f85-007281aa10a0 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:48.428471 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930fc70-e890-4b56-9c1b-b9a5250a4f31 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:48.451776 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:48.476462 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d1da9-ab39-4736-9a81-a99421b50411 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-VG3CU1qTkGdjraXV6CZxA, audit_chain_id=['-VG3CU1qTkGdjraXV6CZxA']) at 0x7f8a0fe66f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:48.478087 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d1da9-ab39-4736-9a81-a99421b50411 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:48.478997 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d1da9-ab39-4736-9a81-a99421b50411 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:48.478997 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d1da9-ab39-4736-9a81-a99421b50411 None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:48.479184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e248e5-8193-4cb0-9f85-007281aa10a0 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:48.480492 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d1da9-ab39-4736-9a81-a99421b50411 None admin] RBAC: Authorizing `identity:get_project(project_id=c312d273f41543edafc129654a960b7b)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:48.483069 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d1da9-ab39-4736-9a81-a99421b50411 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:48.484281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 178/356] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:48 2022] GET /identity/v3/projects/c312d273f41543edafc129654a960b7b => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:48.485794 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d406c-ebbb-425a-b8a8-8274023dc04b None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:48.486088 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d406c-ebbb-425a-b8a8-8274023dc04b None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:48.486366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d406c-ebbb-425a-b8a8-8274023dc04b None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:48.487839 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 179/357] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:48.488299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d406c-ebbb-425a-b8a8-8274023dc04b None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:48.520362 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1879f7-230c-44b4-87bc-a8046626c32c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1tun7R0GQY-9CJ81FqbJIA, audit_chain_id=['1tun7R0GQY-9CJ81FqbJIA']) at 0x7f8a0fe71040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:48.521014 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1879f7-230c-44b4-87bc-a8046626c32c None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:48.521302 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1879f7-230c-44b4-87bc-a8046626c32c None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:48.521607 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1879f7-230c-44b4-87bc-a8046626c32c None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:48.522888 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1879f7-230c-44b4-87bc-a8046626c32c None admin] RBAC: Authorizing `identity:get_project(project_id=fa144b85a37b4dd191df360058c783d1)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:48.524242 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1879f7-230c-44b4-87bc-a8046626c32c None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:48.525934 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 179/358] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:48 2022] GET /identity/v3/projects/fa144b85a37b4dd191df360058c783d1 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:48.527337 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1879f7-230c-44b4-87bc-a8046626c32c None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:48.622989 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d406c-ebbb-425a-b8a8-8274023dc04b None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:48.630518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:48.656918 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1879f7-230c-44b4-87bc-a8046626c32c None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:48.665368 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace6de4-dd29-4534-9acd-d4f284f5a589 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jkAldr55TOGQwRaf2EmxaQ, audit_chain_id=['jkAldr55TOGQwRaf2EmxaQ']) at 0x7f8a14ed2dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:48.666063 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace6de4-dd29-4534-9acd-d4f284f5a589 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:48.666345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace6de4-dd29-4534-9acd-d4f284f5a589 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:48.666621 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace6de4-dd29-4534-9acd-d4f284f5a589 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:48.680045 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace6de4-dd29-4534-9acd-d4f284f5a589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:48.683668 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-4ace6de4-dd29-4534-9acd-d4f284f5a589 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:48.683668 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:48.683668 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:48.683668 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:48.683668 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:48.683668 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:48.683668 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:48.683668 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:48.683668 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:48.683668 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:48.683668 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:48.683668 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:48.683668 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:48.683668 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:48.683668 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:48.683668 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:48.684760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:48.684760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:48.684760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:48.684760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:48.684760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:48.684760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:48.684760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:48.684760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:48.684760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:48.684760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:48.684760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:48.684760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:48.684760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:48.684760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:48.684760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:48.684760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:48.686539 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:48.686539 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:48.686539 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:48.686539 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:48.686539 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:48.686539 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:48.686539 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:48.686539 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:48.686539 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:48.686539 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:48.686539 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:48.686539 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:48.686539 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 180/359] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:47:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:48.686539 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace6de4-dd29-4534-9acd-d4f284f5a589 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:48.705470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37030c80-9a11-4b82-bd8e-5d30a059b28a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WlACNhdeRouppkKVHtR4Xg, audit_chain_id=['WlACNhdeRouppkKVHtR4Xg']) at 0x7f8a0fde0400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:48.706153 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37030c80-9a11-4b82-bd8e-5d30a059b28a None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:48.706434 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37030c80-9a11-4b82-bd8e-5d30a059b28a None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:48.706705 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37030c80-9a11-4b82-bd8e-5d30a059b28a None admin] PATH_INFO: `/v3/users/21d8dd2b53fd4bdd90f99889c4112e0f` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:48.708041 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37030c80-9a11-4b82-bd8e-5d30a059b28a None admin] RBAC: Authorizing `identity:get_user(user_id=21d8dd2b53fd4bdd90f99889c4112e0f)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:48.709288 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37030c80-9a11-4b82-bd8e-5d30a059b28a None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:48.711117 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 180/360] 10.222.0.47 () {56 vars in 1177 bytes} [Mon Jul 25 22:47:48 2022] GET /identity/v3/users/21d8dd2b53fd4bdd90f99889c4112e0f => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:48.712082 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c5e30-9d18-436d-beda-8b777858c9e0 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:48.712367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c5e30-9d18-436d-beda-8b777858c9e0 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:48.712642 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c5e30-9d18-436d-beda-8b777858c9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:48.732636 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-885c5e30-9d18-436d-beda-8b777858c9e0 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:48.733855 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-885c5e30-9d18-436d-beda-8b777858c9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:48.745488 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:48.817711 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 181/361] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:48.822253 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c5e30-9d18-436d-beda-8b777858c9e0 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:48.823107 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace6de4-dd29-4534-9acd-d4f284f5a589 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:48.862235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b328f3f-e573-4b84-8d48-68ba327848ca None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZXjO5oADSuODnBi0B6d5Mw, audit_chain_id=['ZXjO5oADSuODnBi0B6d5Mw']) at 0x7f8a0fe2aca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:48.862880 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b328f3f-e573-4b84-8d48-68ba327848ca None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:48.863160 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b328f3f-e573-4b84-8d48-68ba327848ca None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:48.863436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b328f3f-e573-4b84-8d48-68ba327848ca None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:48.864750 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b328f3f-e573-4b84-8d48-68ba327848ca None admin] RBAC: Authorizing `identity:get_project(project_id=c312d273f41543edafc129654a960b7b)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:48.866222 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b328f3f-e573-4b84-8d48-68ba327848ca None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:48.868763 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 181/362] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:48 2022] GET /identity/v3/projects/c312d273f41543edafc129654a960b7b => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:48.869093 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b328f3f-e573-4b84-8d48-68ba327848ca None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:48.911822 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:48.957463 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c5e30-9d18-436d-beda-8b777858c9e0 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:48.998886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17475ded-9ef8-4609-90c4-0c5116abc99d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-VG3CU1qTkGdjraXV6CZxA, audit_chain_id=['-VG3CU1qTkGdjraXV6CZxA']) at 0x7f8a0fdf1850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:48.999548 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17475ded-9ef8-4609-90c4-0c5116abc99d None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:48.999834 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17475ded-9ef8-4609-90c4-0c5116abc99d None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:48.999963 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b328f3f-e573-4b84-8d48-68ba327848ca None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:49.000108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17475ded-9ef8-4609-90c4-0c5116abc99d None admin] PATH_INFO: `/v3/groups/e5635de691fc441fa29c0dc84457730e` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:49.006269 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17475ded-9ef8-4609-90c4-0c5116abc99d None admin] RBAC: Authorizing `identity:get_group(group_id=e5635de691fc441fa29c0dc84457730e)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:49.007713 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17475ded-9ef8-4609-90c4-0c5116abc99d None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:49.009341 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 182/363] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 22:47:48 2022] GET /identity/v3/groups/e5635de691fc441fa29c0dc84457730e => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:49.010155 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17475ded-9ef8-4609-90c4-0c5116abc99d None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:49.024666 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:49.036916 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beaa521-c8be-4356-bef0-4b0b5ddca8a2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1tun7R0GQY-9CJ81FqbJIA, audit_chain_id=['1tun7R0GQY-9CJ81FqbJIA']) at 0x7f8a14186ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:49.037560 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beaa521-c8be-4356-bef0-4b0b5ddca8a2 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:49.037872 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beaa521-c8be-4356-bef0-4b0b5ddca8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:49.038147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beaa521-c8be-4356-bef0-4b0b5ddca8a2 None admin] PATH_INFO: `/v3/groups/e5635de691fc441fa29c0dc84457730e` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:49.039281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beaa521-c8be-4356-bef0-4b0b5ddca8a2 None admin] RBAC: Authorizing `identity:get_group(group_id=e5635de691fc441fa29c0dc84457730e)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:49.040720 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beaa521-c8be-4356-bef0-4b0b5ddca8a2 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:49.042325 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 182/364] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 22:47:48 2022] GET /identity/v3/groups/e5635de691fc441fa29c0dc84457730e => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:49.043081 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beaa521-c8be-4356-bef0-4b0b5ddca8a2 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:49.118107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17475ded-9ef8-4609-90c4-0c5116abc99d None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:49.143310 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beaa521-c8be-4356-bef0-4b0b5ddca8a2 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:49.144805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:49.153741 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a5cf0-4519-43b1-a664-b346c50b31f7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jkAldr55TOGQwRaf2EmxaQ, audit_chain_id=['jkAldr55TOGQwRaf2EmxaQ']) at 0x7f8a0fe87df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:49.154331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a5cf0-4519-43b1-a664-b346c50b31f7 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:49.154613 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a5cf0-4519-43b1-a664-b346c50b31f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:49.154892 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a5cf0-4519-43b1-a664-b346c50b31f7 None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:49.155597 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a5cf0-4519-43b1-a664-b346c50b31f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:49.155902 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a5cf0-4519-43b1-a664-b346c50b31f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:49.157253 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a5cf0-4519-43b1-a664-b346c50b31f7 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:49.165110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 183/365] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:47:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:49.165911 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a5cf0-4519-43b1-a664-b346c50b31f7 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:49.178275 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047db949-a2c5-4011-8b88-6ac940711ffa None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WlACNhdeRouppkKVHtR4Xg, audit_chain_id=['WlACNhdeRouppkKVHtR4Xg']) at 0x7f8a0fe42cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:49.178890 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047db949-a2c5-4011-8b88-6ac940711ffa None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:49.179168 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047db949-a2c5-4011-8b88-6ac940711ffa None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:49.179440 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047db949-a2c5-4011-8b88-6ac940711ffa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:49.180221 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047db949-a2c5-4011-8b88-6ac940711ffa None admin] RBAC: Adding query filter params (role.id=862b3fa9d6834bd3b14681fc489500a7, user.id=21d8dd2b53fd4bdd90f99889c4112e0f, scope.system=all) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:49.180527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047db949-a2c5-4011-8b88-6ac940711ffa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:49.182015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047db949-a2c5-4011-8b88-6ac940711ffa None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:49.195003 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 183/366] 10.222.0.47 () {56 vars in 1308 bytes} [Mon Jul 25 22:47:49 2022] GET /identity/v3/role_assignments?user.id=21d8dd2b53fd4bdd90f99889c4112e0f&scope.system=all&role.id=862b3fa9d6834bd3b14681fc489500a7 => generated 510 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:49.195793 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047db949-a2c5-4011-8b88-6ac940711ffa None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:49.250453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:49.287403 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a5cf0-4519-43b1-a664-b346c50b31f7 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:49.320413 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047db949-a2c5-4011-8b88-6ac940711ffa None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:49.325979 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca730a49-94ce-44c0-8af0-3b6cc90fa966 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eaJd6F5bSK68cJpJZ5wN1w, audit_chain_id=['eaJd6F5bSK68cJpJZ5wN1w']) at 0x7f8a0fea4e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:49.326453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca730a49-94ce-44c0-8af0-3b6cc90fa966 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:49.326744 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca730a49-94ce-44c0-8af0-3b6cc90fa966 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:49.327026 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca730a49-94ce-44c0-8af0-3b6cc90fa966 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:49.339074 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca730a49-94ce-44c0-8af0-3b6cc90fa966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:49.344985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-ca730a49-94ce-44c0-8af0-3b6cc90fa966 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:47:49.344985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:49.344985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:49.344985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:49.344985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:49.344985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:49.344985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:49.344985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:49.344985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:49.344985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:49.344985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:49.344985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:49.344985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:49.344985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:49.344985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:49.344985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:49.346023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:49.346023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:49.346023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:49.346023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:49.346023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:49.346023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:49.346023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:49.346023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:49.346023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:49.346023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:49.346023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:49.346023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:49.346023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:49.346023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:49.346023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:49.346023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:49.346990 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:49.346990 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:49.346990 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:49.346990 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:49.346990 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:49.346990 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:49.346990 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:49.346990 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:49.346990 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:49.346990 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:49.346990 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:47:49.346990 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:47:49.351136 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 184/367] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 22:47:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:49.352047 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca730a49-94ce-44c0-8af0-3b6cc90fa966 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:49.366919 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87119312-6cb5-40ef-b1e8-39c29d752570 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZXjO5oADSuODnBi0B6d5Mw, audit_chain_id=['ZXjO5oADSuODnBi0B6d5Mw']) at 0x7f8a14136c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:49.367568 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87119312-6cb5-40ef-b1e8-39c29d752570 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:49.367848 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87119312-6cb5-40ef-b1e8-39c29d752570 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:49.368126 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87119312-6cb5-40ef-b1e8-39c29d752570 None admin] PATH_INFO: `/v3/groups/e5635de691fc441fa29c0dc84457730e` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:49.369281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87119312-6cb5-40ef-b1e8-39c29d752570 None admin] RBAC: Authorizing `identity:get_group(group_id=e5635de691fc441fa29c0dc84457730e)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:49.370750 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87119312-6cb5-40ef-b1e8-39c29d752570 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:49.374429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 184/368] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 22:47:49 2022] GET /identity/v3/groups/e5635de691fc441fa29c0dc84457730e => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:49.374429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87119312-6cb5-40ef-b1e8-39c29d752570 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:49.410964 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:49.470411 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca730a49-94ce-44c0-8af0-3b6cc90fa966 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:49.509949 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:49.514683 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87119312-6cb5-40ef-b1e8-39c29d752570 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:49.516817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da99780-ba19-495d-a6c8-63694bc62527 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-VG3CU1qTkGdjraXV6CZxA, audit_chain_id=['-VG3CU1qTkGdjraXV6CZxA']) at 0x7f8a0fe9d9a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:49.517390 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da99780-ba19-495d-a6c8-63694bc62527 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:49.517717 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da99780-ba19-495d-a6c8-63694bc62527 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:49.518000 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da99780-ba19-495d-a6c8-63694bc62527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:49.518803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da99780-ba19-495d-a6c8-63694bc62527 None admin] RBAC: Adding query filter params (group.id=e5635de691fc441fa29c0dc84457730e, role.id=c57f45d724fe45009701c9b2706d661c, scope.project.id=c312d273f41543edafc129654a960b7b) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:49.519116 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da99780-ba19-495d-a6c8-63694bc62527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:49.520553 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da99780-ba19-495d-a6c8-63694bc62527 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:49.526748 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 185/369] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Jul 25 22:47:49 2022] GET /identity/v3/role_assignments?group.id=e5635de691fc441fa29c0dc84457730e&scope.project.id=c312d273f41543edafc129654a960b7b&role.id=c57f45d724fe45009701c9b2706d661c => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:49.528174 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da99780-ba19-495d-a6c8-63694bc62527 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:49.569148 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3c506-9b81-45c8-a79f-ceb611b7100b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1tun7R0GQY-9CJ81FqbJIA, audit_chain_id=['1tun7R0GQY-9CJ81FqbJIA']) at 0x7f8a0fdc1cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:49.570249 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c506-9b81-45c8-a79f-ceb611b7100b None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:49.570249 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c506-9b81-45c8-a79f-ceb611b7100b None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:49.570249 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c506-9b81-45c8-a79f-ceb611b7100b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:49.570855 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3c506-9b81-45c8-a79f-ceb611b7100b None admin] RBAC: Adding query filter params (group.id=e5635de691fc441fa29c0dc84457730e, role.id=c57f45d724fe45009701c9b2706d661c, scope.project.id=fa144b85a37b4dd191df360058c783d1) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:49.571168 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3c506-9b81-45c8-a79f-ceb611b7100b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:49.572980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3c506-9b81-45c8-a79f-ceb611b7100b None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:49.581252 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 185/370] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Jul 25 22:47:49 2022] GET /identity/v3/role_assignments?group.id=e5635de691fc441fa29c0dc84457730e&scope.project.id=fa144b85a37b4dd191df360058c783d1&role.id=c57f45d724fe45009701c9b2706d661c => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:49.585615 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3c506-9b81-45c8-a79f-ceb611b7100b None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:49.684855 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da99780-ba19-495d-a6c8-63694bc62527 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:49.732986 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:49.740798 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbc27b-cfe8-45b2-b182-5a19def816ca None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jkAldr55TOGQwRaf2EmxaQ, audit_chain_id=['jkAldr55TOGQwRaf2EmxaQ']) at 0x7f8a14132df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:49.741438 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbc27b-cfe8-45b2-b182-5a19def816ca None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:49.741763 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbc27b-cfe8-45b2-b182-5a19def816ca None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:49.742045 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddbc27b-cfe8-45b2-b182-5a19def816ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:49.745211 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3c506-9b81-45c8-a79f-ceb611b7100b None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:49.793823 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccea2a-7161-42a4-afc4-198a5e4b09d0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eaJd6F5bSK68cJpJZ5wN1w, audit_chain_id=['eaJd6F5bSK68cJpJZ5wN1w']) at 0x7f8a14127130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:49.794507 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccea2a-7161-42a4-afc4-198a5e4b09d0 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:49.794795 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccea2a-7161-42a4-afc4-198a5e4b09d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:49.795077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccea2a-7161-42a4-afc4-198a5e4b09d0 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:49.795999 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccea2a-7161-42a4-afc4-198a5e4b09d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:49.796742 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccea2a-7161-42a4-afc4-198a5e4b09d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:49.798482 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccea2a-7161-42a4-afc4-198a5e4b09d0 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:49.810458 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 186/371] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:49.811936 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccea2a-7161-42a4-afc4-198a5e4b09d0 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:49.813999 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:49.822859 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbc27b-cfe8-45b2-b182-5a19def816ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:49.824272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddbc27b-cfe8-45b2-b182-5a19def816ca None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:49.923848 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccea2a-7161-42a4-afc4-198a5e4b09d0 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:49.964053 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cd50b-0e2f-409f-800e-bcc00fa34398 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZXjO5oADSuODnBi0B6d5Mw, audit_chain_id=['ZXjO5oADSuODnBi0B6d5Mw']) at 0x7f8a155245b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:49.964755 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cd50b-0e2f-409f-800e-bcc00fa34398 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:49.965044 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cd50b-0e2f-409f-800e-bcc00fa34398 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:49.965757 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 186/372] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:49.966131 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cd50b-0e2f-409f-800e-bcc00fa34398 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:49.966692 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbc27b-cfe8-45b2-b182-5a19def816ca None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:49.967033 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9cd50b-0e2f-409f-800e-bcc00fa34398 None admin] RBAC: Adding query filter params (group.id=e5635de691fc441fa29c0dc84457730e, role.id=e0342a5e42664f35948f522071411514, scope.project.id=c312d273f41543edafc129654a960b7b) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:49.967360 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9cd50b-0e2f-409f-800e-bcc00fa34398 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:49.969015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9cd50b-0e2f-409f-800e-bcc00fa34398 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:49.981694 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 187/373] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Jul 25 22:47:49 2022] GET /identity/v3/role_assignments?group.id=e5635de691fc441fa29c0dc84457730e&scope.project.id=c312d273f41543edafc129654a960b7b&role.id=e0342a5e42664f35948f522071411514 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:49.984175 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cd50b-0e2f-409f-800e-bcc00fa34398 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:50.029197 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:50.169055 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:50.177153 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cd50b-0e2f-409f-800e-bcc00fa34398 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:50.177553 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddbc27b-cfe8-45b2-b182-5a19def816ca None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:50.226654 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ae1a0-e852-4161-a54f-91800c9dec82 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jkAldr55TOGQwRaf2EmxaQ, audit_chain_id=['jkAldr55TOGQwRaf2EmxaQ']) at 0x7f8a0fe422e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:50.228123 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ae1a0-e852-4161-a54f-91800c9dec82 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:50.228632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ae1a0-e852-4161-a54f-91800c9dec82 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:50.229132 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ae1a0-e852-4161-a54f-91800c9dec82 None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:50.231428 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ae1a0-e852-4161-a54f-91800c9dec82 None admin] RBAC: Authorizing `identity:get_project(project_id=fa144b85a37b4dd191df360058c783d1)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:50.233113 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ae1a0-e852-4161-a54f-91800c9dec82 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:50.234542 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd418719-586a-43fb-aae6-66ece900eba5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eaJd6F5bSK68cJpJZ5wN1w, audit_chain_id=['eaJd6F5bSK68cJpJZ5wN1w']) at 0x7f8a142eda30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:50.235189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd418719-586a-43fb-aae6-66ece900eba5 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:50.235478 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd418719-586a-43fb-aae6-66ece900eba5 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:50.235857 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd418719-586a-43fb-aae6-66ece900eba5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:50.236321 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 188/374] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:49 2022] GET /identity/v3/projects/fa144b85a37b4dd191df360058c783d1 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:50.250548 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ae1a0-e852-4161-a54f-91800c9dec82 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:50.389001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:50.408772 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd418719-586a-43fb-aae6-66ece900eba5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:50.409968 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ae1a0-e852-4161-a54f-91800c9dec82 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:50.410282 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd418719-586a-43fb-aae6-66ece900eba5 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:50.453369 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb2859-936c-49b9-9e29-c69b223d019a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jkAldr55TOGQwRaf2EmxaQ, audit_chain_id=['jkAldr55TOGQwRaf2EmxaQ']) at 0x7f8a0fe5bc10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:50.454452 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb2859-936c-49b9-9e29-c69b223d019a None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:50.457785 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb2859-936c-49b9-9e29-c69b223d019a None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:50.458273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb2859-936c-49b9-9e29-c69b223d019a None admin] PATH_INFO: `/v3/groups/e5635de691fc441fa29c0dc84457730e` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:50.459881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb2859-936c-49b9-9e29-c69b223d019a None admin] RBAC: Authorizing `identity:get_group(group_id=e5635de691fc441fa29c0dc84457730e)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:50.461556 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb2859-936c-49b9-9e29-c69b223d019a None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:50.467122 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 189/375] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 22:47:50 2022] GET /identity/v3/groups/e5635de691fc441fa29c0dc84457730e => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:50.473347 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb2859-936c-49b9-9e29-c69b223d019a None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:50.602332 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:50.621161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 187/376] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:50.627027 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd418719-586a-43fb-aae6-66ece900eba5 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:50.706215 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb2859-936c-49b9-9e29-c69b223d019a None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:50.767706 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd418719-586a-43fb-aae6-66ece900eba5 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:50.778987 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ee6bb-6635-4b31-92a9-ab4a4b7fd38b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jkAldr55TOGQwRaf2EmxaQ, audit_chain_id=['jkAldr55TOGQwRaf2EmxaQ']) at 0x7f8a14135550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:50.779975 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ee6bb-6635-4b31-92a9-ab4a4b7fd38b None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:50.780463 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ee6bb-6635-4b31-92a9-ab4a4b7fd38b None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:50.780944 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ee6bb-6635-4b31-92a9-ab4a4b7fd38b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:50.781979 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ee6bb-6635-4b31-92a9-ab4a4b7fd38b None admin] RBAC: Adding query filter params (group.id=e5635de691fc441fa29c0dc84457730e, role.id=e0342a5e42664f35948f522071411514, scope.project.id=fa144b85a37b4dd191df360058c783d1) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:50.782506 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ee6bb-6635-4b31-92a9-ab4a4b7fd38b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:50.784185 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ee6bb-6635-4b31-92a9-ab4a4b7fd38b None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:50.799569 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 190/377] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Jul 25 22:47:50 2022] GET /identity/v3/role_assignments?group.id=e5635de691fc441fa29c0dc84457730e&scope.project.id=fa144b85a37b4dd191df360058c783d1&role.id=e0342a5e42664f35948f522071411514 => generated 260 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:50.813484 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff972ad2-8a2f-48e4-aa6b-34cd24ad2c51 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eaJd6F5bSK68cJpJZ5wN1w, audit_chain_id=['eaJd6F5bSK68cJpJZ5wN1w']) at 0x7f8a151409d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:50.814215 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff972ad2-8a2f-48e4-aa6b-34cd24ad2c51 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:50.814500 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff972ad2-8a2f-48e4-aa6b-34cd24ad2c51 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:50.814778 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff972ad2-8a2f-48e4-aa6b-34cd24ad2c51 None admin] PATH_INFO: `/v3/projects/bbcbafb1154a42cbb08b02e29c87618d` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:50.816078 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff972ad2-8a2f-48e4-aa6b-34cd24ad2c51 None admin] RBAC: Authorizing `identity:get_project(project_id=bbcbafb1154a42cbb08b02e29c87618d)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:50.817551 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff972ad2-8a2f-48e4-aa6b-34cd24ad2c51 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:50.819533 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 188/378] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:50 2022] GET /identity/v3/projects/bbcbafb1154a42cbb08b02e29c87618d => generated 344 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:50.825810 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ee6bb-6635-4b31-92a9-ab4a4b7fd38b None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:50.862308 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:50.976669 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ee6bb-6635-4b31-92a9-ab4a4b7fd38b None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:51.019835 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799c750-a355-4902-ba19-5a8216cc8c23 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eaJd6F5bSK68cJpJZ5wN1w, audit_chain_id=['eaJd6F5bSK68cJpJZ5wN1w']) at 0x7f8a0fdc1970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:51.020934 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799c750-a355-4902-ba19-5a8216cc8c23 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:51.021428 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799c750-a355-4902-ba19-5a8216cc8c23 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:51.021985 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799c750-a355-4902-ba19-5a8216cc8c23 None admin] PATH_INFO: `/v3/groups/e27122c162e944c5ba6aed041c438ccd` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:51.029153 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799c750-a355-4902-ba19-5a8216cc8c23 None admin] RBAC: Authorizing `identity:get_group(group_id=e27122c162e944c5ba6aed041c438ccd)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:51.030973 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799c750-a355-4902-ba19-5a8216cc8c23 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:51.033185 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 191/379] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 22:47:50 2022] GET /identity/v3/groups/e27122c162e944c5ba6aed041c438ccd => generated 229 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:51.041138 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff972ad2-8a2f-48e4-aa6b-34cd24ad2c51 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:51.142854 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:51.195441 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff972ad2-8a2f-48e4-aa6b-34cd24ad2c51 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:51.241525 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf62970-31be-44b9-8ad1-3c67b36df0ae None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eaJd6F5bSK68cJpJZ5wN1w, audit_chain_id=['eaJd6F5bSK68cJpJZ5wN1w']) at 0x7f8a0fdff1c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:51.242561 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf62970-31be-44b9-8ad1-3c67b36df0ae None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:51.243050 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf62970-31be-44b9-8ad1-3c67b36df0ae None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:51.243606 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf62970-31be-44b9-8ad1-3c67b36df0ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:51.244712 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf62970-31be-44b9-8ad1-3c67b36df0ae None admin] RBAC: Adding query filter params (group.id=e27122c162e944c5ba6aed041c438ccd, role.id=6ca03befbf3a456eae350bc7e583488f, scope.project.id=bbcbafb1154a42cbb08b02e29c87618d) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:51.245229 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf62970-31be-44b9-8ad1-3c67b36df0ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:51.247454 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf62970-31be-44b9-8ad1-3c67b36df0ae None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:51.257746 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 189/380] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Jul 25 22:47:51 2022] GET /identity/v3/role_assignments?group.id=e27122c162e944c5ba6aed041c438ccd&scope.project.id=bbcbafb1154a42cbb08b02e29c87618d&role.id=6ca03befbf3a456eae350bc7e583488f => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:52.209617 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2d434-f8a1-4746-8dc9-978bb097579c None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:52.210163 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2d434-f8a1-4746-8dc9-978bb097579c None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:52.210163 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2d434-f8a1-4746-8dc9-978bb097579c None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:52.211781 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 192/381] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:52.217755 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbc26a-4ac4-4110-8465-9577171564bf None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:52.218206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbc26a-4ac4-4110-8465-9577171564bf None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:52.218384 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbc26a-4ac4-4110-8465-9577171564bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:52.246701 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-e2bbc26a-4ac4-4110-8465-9577171564bf None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:52.247908 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-e2bbc26a-4ac4-4110-8465-9577171564bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:52.278979 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b3a2a-ed30-4b90-b463-3a0d3e67321b None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:52.279334 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b3a2a-ed30-4b90-b463-3a0d3e67321b None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:52.279783 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b3a2a-ed30-4b90-b463-3a0d3e67321b None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:52.281472 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 193/382] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:47:52.286881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2add01-664e-42d2-b6bf-ceae6d3d51b6 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:52.287171 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2add01-664e-42d2-b6bf-ceae6d3d51b6 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:52.288018 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2add01-664e-42d2-b6bf-ceae6d3d51b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:52.318666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-1d2add01-664e-42d2-b6bf-ceae6d3d51b6 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:52.320240 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-1d2add01-664e-42d2-b6bf-ceae6d3d51b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:52.361862 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 190/383] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:52.394534 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbc26a-4ac4-4110-8465-9577171564bf None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:52.413722 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 194/384] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:47:52.455347 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2add01-664e-42d2-b6bf-ceae6d3d51b6 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:52.476867 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:52.485641 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:52.582304 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbc26a-4ac4-4110-8465-9577171564bf None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:52.619085 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2add01-664e-42d2-b6bf-ceae6d3d51b6 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:52.646474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43708e-ca2d-4e44-98e3-e2d0215d86e5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8tvN39fFQtCu600H3Jrg3Q, audit_chain_id=['8tvN39fFQtCu600H3Jrg3Q']) at 0x7f8a0fe14340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:52.647131 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43708e-ca2d-4e44-98e3-e2d0215d86e5 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:52.647412 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43708e-ca2d-4e44-98e3-e2d0215d86e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:52.647689 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43708e-ca2d-4e44-98e3-e2d0215d86e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:52.668784 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43708e-ca2d-4e44-98e3-e2d0215d86e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:52.674328 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-0d43708e-ca2d-4e44-98e3-e2d0215d86e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:52.674328 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:52.674328 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:52.674328 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:52.674328 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:52.674328 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:52.674328 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:52.674328 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:52.674328 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:52.674328 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:52.674328 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:52.674328 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:52.674328 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:52.674328 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:52.674328 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:52.674328 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:52.675189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:52.675189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:52.675189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:52.675189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:52.675189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:52.675189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:52.675189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:52.675189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:52.675189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:52.675189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:52.675189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:52.675189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:52.675189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:52.675189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:52.675189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:52.675189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:52.675978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:52.675978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:52.675978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:52.675978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:52.675978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:52.675978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:52.675978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:52.675978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:52.675978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:52.675978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:52.675978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:52.675978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:47:52.677821 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 191/385] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:47:52.681161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43708e-ca2d-4e44-98e3-e2d0215d86e5 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:52.689817 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffea1c-5807-449e-bc92-12ee0335fcc0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sq6pBsgmRriirj4NqGOqxw, audit_chain_id=['sq6pBsgmRriirj4NqGOqxw']) at 0x7f8a0fe55610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:52.690472 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffea1c-5807-449e-bc92-12ee0335fcc0 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:52.690756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffea1c-5807-449e-bc92-12ee0335fcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:52.691030 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffea1c-5807-449e-bc92-12ee0335fcc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:52.712230 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffea1c-5807-449e-bc92-12ee0335fcc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:52.724086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-d9ffea1c-5807-449e-bc92-12ee0335fcc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:52.724086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:52.724086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:52.724086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:52.724086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:52.724086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:52.724086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:52.724086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:52.724086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:52.724086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:52.724086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:52.724086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:52.724086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:52.724086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:52.724086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:52.724086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:52.724977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:52.724977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:52.724977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:52.724977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:52.724977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:52.724977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:52.724977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:52.724977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:52.724977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:52.724977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:52.724977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:52.724977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:52.724977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:52.724977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:52.724977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:52.724977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:52.725828 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:52.725828 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:52.725828 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:52.725828 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:52.725828 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:52.725828 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:52.725828 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:52.725828 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:52.725828 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:52.725828 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:52.725828 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:52.725828 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:52.725828 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 195/386] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:47:52.734719 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffea1c-5807-449e-bc92-12ee0335fcc0 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:52.819138 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43708e-ca2d-4e44-98e3-e2d0215d86e5 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:52.833401 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:52.841878 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:52.860787 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a211b8-9362-41d9-862e-cb91b1d5b60f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8tvN39fFQtCu600H3Jrg3Q, audit_chain_id=['8tvN39fFQtCu600H3Jrg3Q']) at 0x7f8a0fdc85e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:52.861558 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a211b8-9362-41d9-862e-cb91b1d5b60f None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:52.861983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a211b8-9362-41d9-862e-cb91b1d5b60f None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:52.862376 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a211b8-9362-41d9-862e-cb91b1d5b60f None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:52.863337 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a211b8-9362-41d9-862e-cb91b1d5b60f None admin] RBAC: Adding query filter params (name=member) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:52.863691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a211b8-9362-41d9-862e-cb91b1d5b60f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:52.865254 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a211b8-9362-41d9-862e-cb91b1d5b60f None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:52.870425 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffea1c-5807-449e-bc92-12ee0335fcc0 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:52.875344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 192/387] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:52.876718 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2952501-71f2-4386-b0cb-b22a52be17e1 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:52.877111 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2952501-71f2-4386-b0cb-b22a52be17e1 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:52.877495 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2952501-71f2-4386-b0cb-b22a52be17e1 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:52.878841 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 193/388] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:52.883769 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2952501-71f2-4386-b0cb-b22a52be17e1 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:52.911988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54dd07e-ddd3-411a-ae53-76c7fb96d8e4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sq6pBsgmRriirj4NqGOqxw, audit_chain_id=['sq6pBsgmRriirj4NqGOqxw']) at 0x7f8a0fe0cd90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:52.912915 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54dd07e-ddd3-411a-ae53-76c7fb96d8e4 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:52.913358 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54dd07e-ddd3-411a-ae53-76c7fb96d8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:52.913808 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54dd07e-ddd3-411a-ae53-76c7fb96d8e4 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:52.914766 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54dd07e-ddd3-411a-ae53-76c7fb96d8e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:52.915304 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54dd07e-ddd3-411a-ae53-76c7fb96d8e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:52.916887 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54dd07e-ddd3-411a-ae53-76c7fb96d8e4 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:52.931485 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 196/389] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:52.933130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aec0a5-755c-4eac-be5d-3fad4ed936b6 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:52.933561 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aec0a5-755c-4eac-be5d-3fad4ed936b6 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:52.935128 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aec0a5-755c-4eac-be5d-3fad4ed936b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:52.955732 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-71aec0a5-755c-4eac-be5d-3fad4ed936b6 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:52.957351 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-71aec0a5-755c-4eac-be5d-3fad4ed936b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:52.995334 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2952501-71f2-4386-b0cb-b22a52be17e1 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:53.032988 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26795f-b8c0-4b7d-9ded-656ca063938d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8tvN39fFQtCu600H3Jrg3Q, audit_chain_id=['8tvN39fFQtCu600H3Jrg3Q']) at 0x7f8a0fe96f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:53.033719 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26795f-b8c0-4b7d-9ded-656ca063938d None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:53.034010 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26795f-b8c0-4b7d-9ded-656ca063938d None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:53.034290 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26795f-b8c0-4b7d-9ded-656ca063938d None admin] PATH_INFO: `/v3/groups/e5635de691fc441fa29c0dc84457730e` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:53.035563 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26795f-b8c0-4b7d-9ded-656ca063938d None admin] RBAC: Authorizing `identity:get_group(group_id=e5635de691fc441fa29c0dc84457730e)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:53.035836 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 197/390] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:53.036857 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aec0a5-755c-4eac-be5d-3fad4ed936b6 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:53.036972 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26795f-b8c0-4b7d-9ded-656ca063938d None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:53.047012 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 194/391] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 22:47:52 2022] GET /identity/v3/groups/e5635de691fc441fa29c0dc84457730e => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:53.052043 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26795f-b8c0-4b7d-9ded-656ca063938d None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:53.108531 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:53.135187 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:53.154670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aec0a5-755c-4eac-be5d-3fad4ed936b6 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:53.194092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d937fa-78d2-4843-b133-f0045c99cee2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sq6pBsgmRriirj4NqGOqxw, audit_chain_id=['sq6pBsgmRriirj4NqGOqxw']) at 0x7f8a0ffe1850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:53.195632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d937fa-78d2-4843-b133-f0045c99cee2 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:53.196065 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d937fa-78d2-4843-b133-f0045c99cee2 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:53.196415 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d937fa-78d2-4843-b133-f0045c99cee2 None admin] PATH_INFO: `/v3/groups/e5635de691fc441fa29c0dc84457730e` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:53.197910 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d937fa-78d2-4843-b133-f0045c99cee2 None admin] RBAC: Authorizing `identity:get_group(group_id=e5635de691fc441fa29c0dc84457730e)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:53.201056 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d937fa-78d2-4843-b133-f0045c99cee2 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:53.202059 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26795f-b8c0-4b7d-9ded-656ca063938d None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:53.202986 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 198/392] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 22:47:53 2022] GET /identity/v3/groups/e5635de691fc441fa29c0dc84457730e => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:53.206321 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d937fa-78d2-4843-b133-f0045c99cee2 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:53.244003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2ae75-b5c1-4d59-9a2e-f62378a22904 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8tvN39fFQtCu600H3Jrg3Q, audit_chain_id=['8tvN39fFQtCu600H3Jrg3Q']) at 0x7f8a14213a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:53.244593 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2ae75-b5c1-4d59-9a2e-f62378a22904 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:53.244593 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2ae75-b5c1-4d59-9a2e-f62378a22904 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:53.244847 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2ae75-b5c1-4d59-9a2e-f62378a22904 None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:53.246338 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2ae75-b5c1-4d59-9a2e-f62378a22904 None admin] RBAC: Authorizing `identity:get_project(project_id=fa144b85a37b4dd191df360058c783d1)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:53.248216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2ae75-b5c1-4d59-9a2e-f62378a22904 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:53.250639 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 195/393] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:53 2022] GET /identity/v3/projects/fa144b85a37b4dd191df360058c783d1 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:53.251315 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2ae75-b5c1-4d59-9a2e-f62378a22904 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:53.314904 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d937fa-78d2-4843-b133-f0045c99cee2 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:53.353296 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561d306-c04f-48b4-8411-447099243f76 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-4Xn0CA8Tvu9xA-9KhZV6Q, audit_chain_id=['-4Xn0CA8Tvu9xA-9KhZV6Q']) at 0x7f8a14ed2dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:53.354602 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561d306-c04f-48b4-8411-447099243f76 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:53.355145 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561d306-c04f-48b4-8411-447099243f76 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:53.355708 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561d306-c04f-48b4-8411-447099243f76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:53.362013 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:53.368705 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2ae75-b5c1-4d59-9a2e-f62378a22904 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:53.374806 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561d306-c04f-48b4-8411-447099243f76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:53.381917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-f561d306-c04f-48b4-8411-447099243f76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:53.381917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:53.381917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:53.381917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:53.381917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:53.381917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:53.381917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:53.381917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:53.381917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:53.381917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:53.381917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:53.381917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:53.381917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:53.381917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:53.381917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:53.381917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:53.382883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:53.382883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:53.382883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:53.382883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:53.382883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:53.382883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:53.382883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:53.382883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:53.382883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:53.382883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:53.382883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:53.382883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:53.382883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:53.382883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:53.382883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:53.382883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:53.383676 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:53.383676 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:53.383676 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:53.383676 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:53.383676 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:53.383676 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:53.383676 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:53.383676 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:53.383676 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:53.383676 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:53.383676 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:53.383676 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:53.392755 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:53.393056 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 199/394] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:47:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:53.394651 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561d306-c04f-48b4-8411-447099243f76 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:53.409373 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54362d59-e69b-4f36-915d-226b41276031 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sq6pBsgmRriirj4NqGOqxw, audit_chain_id=['sq6pBsgmRriirj4NqGOqxw']) at 0x7f8a155237f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:53.410061 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54362d59-e69b-4f36-915d-226b41276031 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:53.410343 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54362d59-e69b-4f36-915d-226b41276031 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:53.410616 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54362d59-e69b-4f36-915d-226b41276031 None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:53.411992 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54362d59-e69b-4f36-915d-226b41276031 None admin] RBAC: Authorizing `identity:get_project(project_id=c312d273f41543edafc129654a960b7b)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:53.413312 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54362d59-e69b-4f36-915d-226b41276031 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:53.420303 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 196/395] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:53 2022] GET /identity/v3/projects/c312d273f41543edafc129654a960b7b => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:53.421156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54362d59-e69b-4f36-915d-226b41276031 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:53.523206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561d306-c04f-48b4-8411-447099243f76 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:53.529645 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54362d59-e69b-4f36-915d-226b41276031 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:53.564678 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2531f1-1b40-469d-b0e1-cf3a6a6b8c8f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=8tvN39fFQtCu600H3Jrg3Q, audit_chain_id=['8tvN39fFQtCu600H3Jrg3Q']) at 0x7f8a0fe135b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:53.565355 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2531f1-1b40-469d-b0e1-cf3a6a6b8c8f None admin] REQUEST_METHOD: `PUT` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:53.565668 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2531f1-1b40-469d-b0e1-cf3a6a6b8c8f None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:53.565946 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2531f1-1b40-469d-b0e1-cf3a6a6b8c8f None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1/groups/e5635de691fc441fa29c0dc84457730e/roles/c57f45d724fe45009701c9b2706d661c` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:53.567628 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b323dc-7a9f-4e8e-995d-1f4d244d2834 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-4Xn0CA8Tvu9xA-9KhZV6Q, audit_chain_id=['-4Xn0CA8Tvu9xA-9KhZV6Q']) at 0x7f8a0fefd580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:53.567964 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2531f1-1b40-469d-b0e1-cf3a6a6b8c8f None admin] RBAC: Authorizing `identity:create_grant(project_id=fa144b85a37b4dd191df360058c783d1, group_id=e5635de691fc441fa29c0dc84457730e, role_id=c57f45d724fe45009701c9b2706d661c)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:53.568255 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b323dc-7a9f-4e8e-995d-1f4d244d2834 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:53.568538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b323dc-7a9f-4e8e-995d-1f4d244d2834 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:53.568814 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b323dc-7a9f-4e8e-995d-1f4d244d2834 None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:53.569432 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2531f1-1b40-469d-b0e1-cf3a6a6b8c8f None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:53.569529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b323dc-7a9f-4e8e-995d-1f4d244d2834 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:53.569855 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b323dc-7a9f-4e8e-995d-1f4d244d2834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:53.571255 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b323dc-7a9f-4e8e-995d-1f4d244d2834 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:53.585491 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 197/396] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:47:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:53.585491 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b323dc-7a9f-4e8e-995d-1f4d244d2834 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:53.589266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 200/397] 10.222.0.47 () {58 vars in 1442 bytes} [Mon Jul 25 22:47:53 2022] PUT /identity/v3/projects/fa144b85a37b4dd191df360058c783d1/groups/e5635de691fc441fa29c0dc84457730e/roles/c57f45d724fe45009701c9b2706d661c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:47:53.591194 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40ff94-c878-4180-a401-7da8ceb92385 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:53.591487 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40ff94-c878-4180-a401-7da8ceb92385 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:53.591762 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40ff94-c878-4180-a401-7da8ceb92385 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:53.593014 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 201/398] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:53.593772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40ff94-c878-4180-a401-7da8ceb92385 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:53.655779 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:53.670031 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:53.721312 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40ff94-c878-4180-a401-7da8ceb92385 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:53.749384 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b323dc-7a9f-4e8e-995d-1f4d244d2834 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:53.767180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a9958-6c8e-48a2-994b-5a7b75c61a68 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-4Xn0CA8Tvu9xA-9KhZV6Q, audit_chain_id=['-4Xn0CA8Tvu9xA-9KhZV6Q']) at 0x7f8a0fe20f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:53.767857 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a9958-6c8e-48a2-994b-5a7b75c61a68 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:53.768142 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a9958-6c8e-48a2-994b-5a7b75c61a68 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:53.768417 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a9958-6c8e-48a2-994b-5a7b75c61a68 None admin] PATH_INFO: `/v3/groups/e5635de691fc441fa29c0dc84457730e` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:53.769623 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a9958-6c8e-48a2-994b-5a7b75c61a68 None admin] RBAC: Authorizing `identity:get_group(group_id=e5635de691fc441fa29c0dc84457730e)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:53.771081 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a9958-6c8e-48a2-994b-5a7b75c61a68 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:53.772694 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 202/399] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 22:47:53 2022] GET /identity/v3/groups/e5635de691fc441fa29c0dc84457730e => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:53.775288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be32d25-e8e3-45b3-ba45-3f2f53d8a648 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:53.775288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be32d25-e8e3-45b3-ba45-3f2f53d8a648 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:53.775288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be32d25-e8e3-45b3-ba45-3f2f53d8a648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:53.799236 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-3be32d25-e8e3-45b3-ba45-3f2f53d8a648 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:53.801415 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-3be32d25-e8e3-45b3-ba45-3f2f53d8a648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:53.807354 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca41ed-97c8-48ab-9a5c-ec6536b10519 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sq6pBsgmRriirj4NqGOqxw, audit_chain_id=['sq6pBsgmRriirj4NqGOqxw']) at 0x7f8a0fea48b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:53.808089 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca41ed-97c8-48ab-9a5c-ec6536b10519 None admin] REQUEST_METHOD: `PUT` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:53.808378 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca41ed-97c8-48ab-9a5c-ec6536b10519 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:53.809264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca41ed-97c8-48ab-9a5c-ec6536b10519 None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b/groups/e5635de691fc441fa29c0dc84457730e/roles/c57f45d724fe45009701c9b2706d661c` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:53.811821 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca41ed-97c8-48ab-9a5c-ec6536b10519 None admin] RBAC: Authorizing `identity:create_grant(project_id=c312d273f41543edafc129654a960b7b, group_id=e5635de691fc441fa29c0dc84457730e, role_id=c57f45d724fe45009701c9b2706d661c)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:53.813479 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca41ed-97c8-48ab-9a5c-ec6536b10519 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:53.830562 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 198/400] 10.222.0.47 () {58 vars in 1442 bytes} [Mon Jul 25 22:47:53 2022] PUT /identity/v3/projects/c312d273f41543edafc129654a960b7b/groups/e5635de691fc441fa29c0dc84457730e/roles/c57f45d724fe45009701c9b2706d661c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:47:53.831418 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca41ed-97c8-48ab-9a5c-ec6536b10519 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:53.947432 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 203/401] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:53.957366 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca41ed-97c8-48ab-9a5c-ec6536b10519 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:53.966779 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:53.976701 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ad81b-0fc9-4529-a40f-ba5d6dd2075a None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:53.977025 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ad81b-0fc9-4529-a40f-ba5d6dd2075a None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:53.977276 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ad81b-0fc9-4529-a40f-ba5d6dd2075a None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:53.978989 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 204/402] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:47:53.989105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afda55d-c318-4b1a-bf5a-a377fc444270 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:53.989411 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afda55d-c318-4b1a-bf5a-a377fc444270 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:53.989784 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afda55d-c318-4b1a-bf5a-a377fc444270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:54.002898 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e15aee-9af5-4f11-9535-004dcb8b7049 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-4Xn0CA8Tvu9xA-9KhZV6Q, audit_chain_id=['-4Xn0CA8Tvu9xA-9KhZV6Q']) at 0x7f8a0fe25280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:54.003574 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e15aee-9af5-4f11-9535-004dcb8b7049 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:54.003863 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e15aee-9af5-4f11-9535-004dcb8b7049 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:54.004148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e15aee-9af5-4f11-9535-004dcb8b7049 None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:54.005568 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e15aee-9af5-4f11-9535-004dcb8b7049 None admin] RBAC: Authorizing `identity:get_project(project_id=c312d273f41543edafc129654a960b7b)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:54.007248 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e15aee-9af5-4f11-9535-004dcb8b7049 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:54.009331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 199/403] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:53 2022] GET /identity/v3/projects/c312d273f41543edafc129654a960b7b => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:54.010004 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e15aee-9af5-4f11-9535-004dcb8b7049 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:54.018098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-2afda55d-c318-4b1a-bf5a-a377fc444270 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:54.019645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-2afda55d-c318-4b1a-bf5a-a377fc444270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:54.087646 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:54.117257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 205/404] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:54.118313 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afda55d-c318-4b1a-bf5a-a377fc444270 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:54.139120 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e15aee-9af5-4f11-9535-004dcb8b7049 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:54.178076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280276b-9bfa-4114-b308-26a1a00ff16c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cmvtTaPbRRa-MAwJgbfkVQ, audit_chain_id=['cmvtTaPbRRa-MAwJgbfkVQ']) at 0x7f8a0fe9d670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:54.178835 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280276b-9bfa-4114-b308-26a1a00ff16c None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:54.179125 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280276b-9bfa-4114-b308-26a1a00ff16c None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:54.179402 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280276b-9bfa-4114-b308-26a1a00ff16c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:54.191705 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280276b-9bfa-4114-b308-26a1a00ff16c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:54.197529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-b280276b-9bfa-4114-b308-26a1a00ff16c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:54.197529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:54.197529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:54.197529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:54.197529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:54.197529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:54.197529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:54.197529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:54.197529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:54.197529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:54.197529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:54.197529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:54.197529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:54.197529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:54.197529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:54.197529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:54.198437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:54.198437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:54.198437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:54.198437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:54.198437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:54.198437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:54.198437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:54.198437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:54.198437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:54.198437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:54.198437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:54.198437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:54.198437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:54.198437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:54.198437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:54.198437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:54.199258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:54.199258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:54.199258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:54.199258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:54.199258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:54.199258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:54.199258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:54.199258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:54.199258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:54.199258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:54.199258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:54.199258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:47:54.199258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 200/405] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:47:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:54.200129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280276b-9bfa-4114-b308-26a1a00ff16c None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:54.245915 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:54.267566 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afda55d-c318-4b1a-bf5a-a377fc444270 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:54.307807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c6c51-e699-4fff-b153-6a79309db9e5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-4Xn0CA8Tvu9xA-9KhZV6Q, audit_chain_id=['-4Xn0CA8Tvu9xA-9KhZV6Q']) at 0x7f8a14110f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:54.308628 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c6c51-e699-4fff-b153-6a79309db9e5 None admin] REQUEST_METHOD: `PUT` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:54.309717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c6c51-e699-4fff-b153-6a79309db9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:54.310073 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c6c51-e699-4fff-b153-6a79309db9e5 None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b/groups/e5635de691fc441fa29c0dc84457730e/roles/e0342a5e42664f35948f522071411514` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:54.312587 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c6c51-e699-4fff-b153-6a79309db9e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c312d273f41543edafc129654a960b7b, group_id=e5635de691fc441fa29c0dc84457730e, role_id=e0342a5e42664f35948f522071411514)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:54.314329 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c6c51-e699-4fff-b153-6a79309db9e5 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:54.327817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280276b-9bfa-4114-b308-26a1a00ff16c None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:54.331841 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 206/406] 10.222.0.47 () {58 vars in 1442 bytes} [Mon Jul 25 22:47:54 2022] PUT /identity/v3/projects/c312d273f41543edafc129654a960b7b/groups/e5635de691fc441fa29c0dc84457730e/roles/e0342a5e42664f35948f522071411514 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:47:54.332865 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c6c51-e699-4fff-b153-6a79309db9e5 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:54.381048 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bc22a-eef3-42f5-a3fa-f60ccaab0409 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FNBI6JUGTaeC3Mwkb29GWQ, audit_chain_id=['FNBI6JUGTaeC3Mwkb29GWQ']) at 0x7f8a155235b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:54.382039 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bc22a-eef3-42f5-a3fa-f60ccaab0409 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:54.382396 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bc22a-eef3-42f5-a3fa-f60ccaab0409 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:54.382743 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bc22a-eef3-42f5-a3fa-f60ccaab0409 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:54.394213 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:54.400103 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156bc22a-eef3-42f5-a3fa-f60ccaab0409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:54.408445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-156bc22a-eef3-42f5-a3fa-f60ccaab0409 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:47:54.408445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:54.408445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:54.408445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:54.408445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:54.408445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:54.408445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:54.408445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:54.408445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:54.408445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:54.408445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:54.408445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:54.408445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:54.408445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:54.408445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:54.408445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:54.409394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:54.409394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:54.409394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:54.409394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:54.409394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:54.409394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:54.409394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:54.409394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:54.409394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:54.409394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:54.409394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:54.409394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:54.409394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:54.409394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:54.409394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:54.409394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:54.410246 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:54.410246 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:54.410246 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:54.410246 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:54.410246 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:54.410246 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:54.410246 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:54.410246 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:54.410246 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:54.410246 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:54.410246 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:47:54.410246 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:47:54.410848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 201/407] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 22:47:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:54.417214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bc22a-eef3-42f5-a3fa-f60ccaab0409 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:54.531895 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c6c51-e699-4fff-b153-6a79309db9e5 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:54.568717 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:54.582874 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bc22a-eef3-42f5-a3fa-f60ccaab0409 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:54.597420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830ab1e-8cec-4ad2-8969-bf0b14cc1733 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cmvtTaPbRRa-MAwJgbfkVQ, audit_chain_id=['cmvtTaPbRRa-MAwJgbfkVQ']) at 0x7f8a0fe5be80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:54.598293 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830ab1e-8cec-4ad2-8969-bf0b14cc1733 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:54.598728 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830ab1e-8cec-4ad2-8969-bf0b14cc1733 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:54.599352 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830ab1e-8cec-4ad2-8969-bf0b14cc1733 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:54.600597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830ab1e-8cec-4ad2-8969-bf0b14cc1733 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:54.601056 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830ab1e-8cec-4ad2-8969-bf0b14cc1733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:54.603054 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3830ab1e-8cec-4ad2-8969-bf0b14cc1733 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:54.614554 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 207/408] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:47:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:54.620543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830ab1e-8cec-4ad2-8969-bf0b14cc1733 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:54.629137 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb7bf8-01b9-4e30-9ac7-da8373347cd5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FNBI6JUGTaeC3Mwkb29GWQ, audit_chain_id=['FNBI6JUGTaeC3Mwkb29GWQ']) at 0x7f8a1434fe80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:54.629877 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb7bf8-01b9-4e30-9ac7-da8373347cd5 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:54.630166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb7bf8-01b9-4e30-9ac7-da8373347cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:54.630449 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb7bf8-01b9-4e30-9ac7-da8373347cd5 None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:54.631230 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb7bf8-01b9-4e30-9ac7-da8373347cd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:54.631481 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb7bf8-01b9-4e30-9ac7-da8373347cd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:54.632869 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb7bf8-01b9-4e30-9ac7-da8373347cd5 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:54.644500 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 202/409] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:54.649479 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb7bf8-01b9-4e30-9ac7-da8373347cd5 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:54.760993 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830ab1e-8cec-4ad2-8969-bf0b14cc1733 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:54.763433 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:54.771042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb7bf8-01b9-4e30-9ac7-da8373347cd5 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:54.810388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691eaf0-b5c1-4de3-835c-d6357c5b97be None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FNBI6JUGTaeC3Mwkb29GWQ, audit_chain_id=['FNBI6JUGTaeC3Mwkb29GWQ']) at 0x7f8a0fe6d5e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:54.810621 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea794c93-23db-468c-9132-af15f67116f3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cmvtTaPbRRa-MAwJgbfkVQ, audit_chain_id=['cmvtTaPbRRa-MAwJgbfkVQ']) at 0x7f8a0fe6ae80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:54.811292 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691eaf0-b5c1-4de3-835c-d6357c5b97be None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:54.811593 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea794c93-23db-468c-9132-af15f67116f3 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:54.811761 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691eaf0-b5c1-4de3-835c-d6357c5b97be None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:54.812143 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691eaf0-b5c1-4de3-835c-d6357c5b97be None admin] PATH_INFO: `/v3/groups/e27122c162e944c5ba6aed041c438ccd` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:54.812286 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea794c93-23db-468c-9132-af15f67116f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:54.812701 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea794c93-23db-468c-9132-af15f67116f3 None admin] PATH_INFO: `/v3/groups/e5635de691fc441fa29c0dc84457730e` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:54.813733 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691eaf0-b5c1-4de3-835c-d6357c5b97be None admin] RBAC: Authorizing `identity:get_group(group_id=e27122c162e944c5ba6aed041c438ccd)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:54.814280 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea794c93-23db-468c-9132-af15f67116f3 None admin] RBAC: Authorizing `identity:get_group(group_id=e5635de691fc441fa29c0dc84457730e)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:54.815358 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691eaf0-b5c1-4de3-835c-d6357c5b97be None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:54.816042 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea794c93-23db-468c-9132-af15f67116f3 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:54.817604 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 203/410] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 22:47:54 2022] GET /identity/v3/groups/e27122c162e944c5ba6aed041c438ccd => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:54.818201 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 208/411] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 22:47:54 2022] GET /identity/v3/groups/e5635de691fc441fa29c0dc84457730e => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:54.823442 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea794c93-23db-468c-9132-af15f67116f3 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:54.823952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691eaf0-b5c1-4de3-835c-d6357c5b97be None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:54.857252 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:54.949918 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691eaf0-b5c1-4de3-835c-d6357c5b97be None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:54.995796 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6982d6-2bbf-484f-be92-4363c19fbceb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cmvtTaPbRRa-MAwJgbfkVQ, audit_chain_id=['cmvtTaPbRRa-MAwJgbfkVQ']) at 0x7f8a0fdc00d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:54.996760 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6982d6-2bbf-484f-be92-4363c19fbceb None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:54.997244 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6982d6-2bbf-484f-be92-4363c19fbceb None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:54.997697 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6982d6-2bbf-484f-be92-4363c19fbceb None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:54.999048 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6982d6-2bbf-484f-be92-4363c19fbceb None admin] RBAC: Authorizing `identity:get_project(project_id=fa144b85a37b4dd191df360058c783d1)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:55.001645 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6982d6-2bbf-484f-be92-4363c19fbceb None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:55.003832 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 204/412] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:54 2022] GET /identity/v3/projects/fa144b85a37b4dd191df360058c783d1 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:55.010474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6982d6-2bbf-484f-be92-4363c19fbceb None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:55.076753 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea794c93-23db-468c-9132-af15f67116f3 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:55.116252 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:55.127967 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6982d6-2bbf-484f-be92-4363c19fbceb None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:55.164844 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57553d3-d500-42e9-bcf6-b1ff1f757438 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cmvtTaPbRRa-MAwJgbfkVQ, audit_chain_id=['cmvtTaPbRRa-MAwJgbfkVQ']) at 0x7f8a0fdc3a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:55.165911 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57553d3-d500-42e9-bcf6-b1ff1f757438 None admin] REQUEST_METHOD: `PUT` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:55.166421 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57553d3-d500-42e9-bcf6-b1ff1f757438 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:55.166846 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57553d3-d500-42e9-bcf6-b1ff1f757438 None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1/groups/e5635de691fc441fa29c0dc84457730e/roles/e0342a5e42664f35948f522071411514` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:55.169539 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57553d3-d500-42e9-bcf6-b1ff1f757438 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa144b85a37b4dd191df360058c783d1, group_id=e5635de691fc441fa29c0dc84457730e, role_id=e0342a5e42664f35948f522071411514)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:55.171350 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57553d3-d500-42e9-bcf6-b1ff1f757438 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:55.187241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 205/413] 10.222.0.47 () {58 vars in 1442 bytes} [Mon Jul 25 22:47:55 2022] PUT /identity/v3/projects/fa144b85a37b4dd191df360058c783d1/groups/e5635de691fc441fa29c0dc84457730e/roles/e0342a5e42664f35948f522071411514 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:47:55.192938 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81df563-de3e-4fce-b35d-92f6e8c2e67f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FNBI6JUGTaeC3Mwkb29GWQ, audit_chain_id=['FNBI6JUGTaeC3Mwkb29GWQ']) at 0x7f8a0fe3f250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:55.193919 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81df563-de3e-4fce-b35d-92f6e8c2e67f None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:55.194376 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81df563-de3e-4fce-b35d-92f6e8c2e67f None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:55.194829 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81df563-de3e-4fce-b35d-92f6e8c2e67f None admin] PATH_INFO: `/v3/projects/bbcbafb1154a42cbb08b02e29c87618d` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:55.196344 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81df563-de3e-4fce-b35d-92f6e8c2e67f None admin] RBAC: Authorizing `identity:get_project(project_id=bbcbafb1154a42cbb08b02e29c87618d)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:55.198050 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81df563-de3e-4fce-b35d-92f6e8c2e67f None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:55.201126 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 209/414] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:54 2022] GET /identity/v3/projects/bbcbafb1154a42cbb08b02e29c87618d => generated 344 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:55.206769 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57553d3-d500-42e9-bcf6-b1ff1f757438 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:55.368100 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57553d3-d500-42e9-bcf6-b1ff1f757438 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:55.424195 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01403571-e929-4b96-a85f-9a573ab7030d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FNBI6JUGTaeC3Mwkb29GWQ, audit_chain_id=['FNBI6JUGTaeC3Mwkb29GWQ']) at 0x7f8a0fee1100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:55.424890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01403571-e929-4b96-a85f-9a573ab7030d None admin] REQUEST_METHOD: `PUT` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:55.425182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01403571-e929-4b96-a85f-9a573ab7030d None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:55.425462 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01403571-e929-4b96-a85f-9a573ab7030d None admin] PATH_INFO: `/v3/projects/bbcbafb1154a42cbb08b02e29c87618d/groups/e27122c162e944c5ba6aed041c438ccd/roles/6ca03befbf3a456eae350bc7e583488f` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:55.429238 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01403571-e929-4b96-a85f-9a573ab7030d None admin] RBAC: Authorizing `identity:create_grant(project_id=bbcbafb1154a42cbb08b02e29c87618d, group_id=e27122c162e944c5ba6aed041c438ccd, role_id=6ca03befbf3a456eae350bc7e583488f)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:55.430169 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01403571-e929-4b96-a85f-9a573ab7030d None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:55.448221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 206/415] 10.222.0.47 () {58 vars in 1442 bytes} [Mon Jul 25 22:47:55 2022] PUT /identity/v3/projects/bbcbafb1154a42cbb08b02e29c87618d/groups/e27122c162e944c5ba6aed041c438ccd/roles/6ca03befbf3a456eae350bc7e583488f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:47:56.297283 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819596d-9634-4866-b960-364087422a76 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:56.297824 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819596d-9634-4866-b960-364087422a76 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:56.297933 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819596d-9634-4866-b960-364087422a76 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:56.299543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 210/416] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:56.304353 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311280f-3bf9-456e-9126-a31dcaeb48e8 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:56.304648 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311280f-3bf9-456e-9126-a31dcaeb48e8 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:56.304932 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311280f-3bf9-456e-9126-a31dcaeb48e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:56.334645 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-f311280f-3bf9-456e-9126-a31dcaeb48e8 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:56.335861 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-f311280f-3bf9-456e-9126-a31dcaeb48e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:56.344669 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:56.423849 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 207/417] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:47:56.459781 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819596d-9634-4866-b960-364087422a76 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:56.524132 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:56.623396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819596d-9634-4866-b960-364087422a76 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:56.672567 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f1154-95d4-4ac6-ade7-1cd42309fbd6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3A8rqVKyT3-lLN1N4JHI6A, audit_chain_id=['3A8rqVKyT3-lLN1N4JHI6A']) at 0x7f8a0fdceb80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:56.673239 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f1154-95d4-4ac6-ade7-1cd42309fbd6 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:56.673605 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f1154-95d4-4ac6-ade7-1cd42309fbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:56.673945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f1154-95d4-4ac6-ade7-1cd42309fbd6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:56.686925 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f1154-95d4-4ac6-ade7-1cd42309fbd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:56.692600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-7a0f1154-95d4-4ac6-ade7-1cd42309fbd6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:56.692600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:56.692600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:56.692600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:56.692600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:56.692600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:56.692600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:56.692600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:56.692600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:56.692600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:56.692600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:56.692600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:56.692600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:56.692600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:56.692600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:56.692600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:56.693461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:56.693461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:56.693461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:56.693461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:56.693461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:56.693461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:56.693461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:56.693461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:56.693461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:56.693461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:56.693461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:56.693461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:56.693461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:56.693461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:56.693461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:56.693461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:56.694300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:56.694300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:56.694300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:56.694300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:56.694300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:56.694300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:56.694300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:56.694300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:56.694300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:56.694300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:56.694300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:56.694300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:56.694300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 211/418] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:56.700878 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311280f-3bf9-456e-9126-a31dcaeb48e8 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:56.778332 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510e72f-f972-4e02-b5f8-d8b3695bcd52 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:56.778697 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510e72f-f972-4e02-b5f8-d8b3695bcd52 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:56.778988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510e72f-f972-4e02-b5f8-d8b3695bcd52 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:56.780506 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 212/419] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:47:56.785757 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e1da0-2419-4d2d-aba9-7ebf3be3a769 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:56.786045 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e1da0-2419-4d2d-aba9-7ebf3be3a769 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:56.786327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e1da0-2419-4d2d-aba9-7ebf3be3a769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:56.820797 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-9d0e1da0-2419-4d2d-aba9-7ebf3be3a769 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:56.822039 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-9d0e1da0-2419-4d2d-aba9-7ebf3be3a769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:56.844267 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311280f-3bf9-456e-9126-a31dcaeb48e8 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:56.918556 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b4291-a382-4214-a24b-1071cd6d0a19 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3A8rqVKyT3-lLN1N4JHI6A, audit_chain_id=['3A8rqVKyT3-lLN1N4JHI6A']) at 0x7f8a0fe96160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:56.919264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b4291-a382-4214-a24b-1071cd6d0a19 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:56.919551 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b4291-a382-4214-a24b-1071cd6d0a19 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:56.919832 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b4291-a382-4214-a24b-1071cd6d0a19 None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:56.920563 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b4291-a382-4214-a24b-1071cd6d0a19 None admin] RBAC: Adding query filter params (name=member) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:56.920868 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b4291-a382-4214-a24b-1071cd6d0a19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:56.922269 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b4291-a382-4214-a24b-1071cd6d0a19 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:56.943607 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 208/420] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:56.949542 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b4291-a382-4214-a24b-1071cd6d0a19 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:56.965980 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:56.976215 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 213/421] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:57.045190 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e1da0-2419-4d2d-aba9-7ebf3be3a769 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:57.077129 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:57.090620 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b4291-a382-4214-a24b-1071cd6d0a19 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:57.129312 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f5b46-2760-4765-be61-2b73aadf2b1f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3A8rqVKyT3-lLN1N4JHI6A, audit_chain_id=['3A8rqVKyT3-lLN1N4JHI6A']) at 0x7f8a14d54370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:57.130317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f5b46-2760-4765-be61-2b73aadf2b1f None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:57.130814 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f5b46-2760-4765-be61-2b73aadf2b1f None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:57.131284 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f5b46-2760-4765-be61-2b73aadf2b1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:57.174802 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e1da0-2419-4d2d-aba9-7ebf3be3a769 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:57.214552 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f5b46-2760-4765-be61-2b73aadf2b1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:57.216685 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f5b46-2760-4765-be61-2b73aadf2b1f None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:57.217901 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c591b-5b3c-4324-9a63-3c7a6ac6709f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=DSjqtvGOQHKPr97PnNqhQQ, audit_chain_id=['DSjqtvGOQHKPr97PnNqhQQ']) at 0x7f8a0fe0c9a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:57.218664 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c591b-5b3c-4324-9a63-3c7a6ac6709f None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:57.219036 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c591b-5b3c-4324-9a63-3c7a6ac6709f None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:57.219537 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c591b-5b3c-4324-9a63-3c7a6ac6709f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:57.220022 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:57.233188 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c591b-5b3c-4324-9a63-3c7a6ac6709f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:57.238670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-3f3c591b-5b3c-4324-9a63-3c7a6ac6709f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:57.238670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:57.238670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:57.238670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:57.238670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:57.238670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:57.238670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:57.238670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:57.238670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:57.238670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:57.238670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:57.238670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:57.238670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:57.238670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:57.238670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:57.238670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:57.239552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:57.239552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:57.239552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:57.239552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:57.239552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:57.239552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:57.239552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:57.239552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:57.239552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:57.239552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:57.239552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:57.239552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:57.239552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:57.239552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:57.239552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:57.239552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:57.240339 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:57.240339 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:57.240339 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:57.240339 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:57.240339 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:57.240339 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:57.240339 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:57.240339 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:57.240339 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:57.240339 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:57.240339 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:47:57.240339 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:57.248575 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 214/422] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:47:57.250680 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cb1d9-941b-4470-bdcc-b4d0ee025daa None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:57.251168 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cb1d9-941b-4470-bdcc-b4d0ee025daa None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:57.251640 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cb1d9-941b-4470-bdcc-b4d0ee025daa None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:57.257257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 215/423] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:57.258620 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cb1d9-941b-4470-bdcc-b4d0ee025daa None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:57.341819 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 209/424] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:47:57.343126 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e26f9a-e85f-4394-9e1f-9ffa32d0caca None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:57.343461 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e26f9a-e85f-4394-9e1f-9ffa32d0caca None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:57.343746 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e26f9a-e85f-4394-9e1f-9ffa32d0caca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:57.360287 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:57.365819 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-a5e26f9a-e85f-4394-9e1f-9ffa32d0caca None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:57.367619 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-a5e26f9a-e85f-4394-9e1f-9ffa32d0caca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:57.377147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cb1d9-941b-4470-bdcc-b4d0ee025daa None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:57.415581 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cc906-68ee-4eb1-bc33-cffbf84d38c9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=DSjqtvGOQHKPr97PnNqhQQ, audit_chain_id=['DSjqtvGOQHKPr97PnNqhQQ']) at 0x7f8a0fe13eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:57.416573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cc906-68ee-4eb1-bc33-cffbf84d38c9 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:57.417073 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cc906-68ee-4eb1-bc33-cffbf84d38c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:57.417541 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cc906-68ee-4eb1-bc33-cffbf84d38c9 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:57.418538 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cc906-68ee-4eb1-bc33-cffbf84d38c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:57.419040 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cc906-68ee-4eb1-bc33-cffbf84d38c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:57.420675 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cc906-68ee-4eb1-bc33-cffbf84d38c9 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:57.434800 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 216/425] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:47:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:57.435991 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cc906-68ee-4eb1-bc33-cffbf84d38c9 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:57.461601 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 210/426] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:57.461601 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e26f9a-e85f-4394-9e1f-9ffa32d0caca None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:57.494584 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:57.568761 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cc906-68ee-4eb1-bc33-cffbf84d38c9 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:57.585729 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e26f9a-e85f-4394-9e1f-9ffa32d0caca None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:57.607591 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636aa32-c3d3-4eae-a58b-c2815b07aed2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3A8rqVKyT3-lLN1N4JHI6A, audit_chain_id=['3A8rqVKyT3-lLN1N4JHI6A']) at 0x7f8a0fe6a850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:57.608585 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636aa32-c3d3-4eae-a58b-c2815b07aed2 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:57.609062 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636aa32-c3d3-4eae-a58b-c2815b07aed2 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:57.609714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636aa32-c3d3-4eae-a58b-c2815b07aed2 None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:57.611094 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636aa32-c3d3-4eae-a58b-c2815b07aed2 None admin] RBAC: Authorizing `identity:get_project(project_id=fa144b85a37b4dd191df360058c783d1)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:57.612902 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636aa32-c3d3-4eae-a58b-c2815b07aed2 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:57.615345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 217/427] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:57 2022] GET /identity/v3/projects/fa144b85a37b4dd191df360058c783d1 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:57.616426 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636aa32-c3d3-4eae-a58b-c2815b07aed2 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:57.634237 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf31e7-7ac1-414e-935e-84964b4c935f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=DSjqtvGOQHKPr97PnNqhQQ, audit_chain_id=['DSjqtvGOQHKPr97PnNqhQQ']) at 0x7f8a14d54190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:57.634889 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf31e7-7ac1-414e-935e-84964b4c935f None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:57.635176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf31e7-7ac1-414e-935e-84964b4c935f None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:57.635457 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf31e7-7ac1-414e-935e-84964b4c935f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:57.644854 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:57.723613 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf31e7-7ac1-414e-935e-84964b4c935f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:57.725565 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf31e7-7ac1-414e-935e-84964b4c935f None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:57.741425 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636aa32-c3d3-4eae-a58b-c2815b07aed2 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:57.763290 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:57.792257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381a078-d7c7-4f09-bd27-c6a7cc50ef5a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n__Tb4JLRJOgt_dzpgHEjw, audit_chain_id=['n__Tb4JLRJOgt_dzpgHEjw']) at 0x7f8a0ffe1850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:57.793810 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381a078-d7c7-4f09-bd27-c6a7cc50ef5a None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:57.794100 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381a078-d7c7-4f09-bd27-c6a7cc50ef5a None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:57.794380 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381a078-d7c7-4f09-bd27-c6a7cc50ef5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:57.812619 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381a078-d7c7-4f09-bd27-c6a7cc50ef5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:57.818950 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-d381a078-d7c7-4f09-bd27-c6a7cc50ef5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:57.818950 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:57.818950 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:57.818950 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:57.818950 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:57.818950 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:57.818950 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:57.818950 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:57.818950 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:57.818950 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:57.818950 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:57.818950 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:57.818950 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:57.818950 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:57.818950 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:57.818950 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:57.819894 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:57.819894 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:57.819894 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:57.819894 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:57.819894 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:57.819894 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:57.819894 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:57.819894 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:57.819894 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:57.819894 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:57.819894 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:57.819894 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:57.819894 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:57.819894 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:57.819894 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:57.819894 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:57.820711 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:57.820711 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:57.820711 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:57.820711 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:57.820711 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:57.820711 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:57.820711 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:57.820711 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:57.820711 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:57.820711 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:57.820711 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:57.820711 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:57.828686 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 218/428] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:47:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:57.829865 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381a078-d7c7-4f09-bd27-c6a7cc50ef5a None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:57.845344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 211/429] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:57.850031 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf31e7-7ac1-414e-935e-84964b4c935f None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:57.917632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:57.945255 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381a078-d7c7-4f09-bd27-c6a7cc50ef5a None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:57.971830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf31e7-7ac1-414e-935e-84964b4c935f None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:57.983620 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88babb70-b184-4246-8adf-ebf56451fba2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3A8rqVKyT3-lLN1N4JHI6A, audit_chain_id=['3A8rqVKyT3-lLN1N4JHI6A']) at 0x7f8a0fd88ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:57.984426 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88babb70-b184-4246-8adf-ebf56451fba2 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:57.984732 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88babb70-b184-4246-8adf-ebf56451fba2 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:57.985048 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88babb70-b184-4246-8adf-ebf56451fba2 None admin] PATH_INFO: `/v3/groups/e5635de691fc441fa29c0dc84457730e` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:57.986432 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88babb70-b184-4246-8adf-ebf56451fba2 None admin] RBAC: Authorizing `identity:get_group(group_id=e5635de691fc441fa29c0dc84457730e)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:57.988147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88babb70-b184-4246-8adf-ebf56451fba2 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:57.995088 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 219/430] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 22:47:57 2022] GET /identity/v3/groups/e5635de691fc441fa29c0dc84457730e => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:57.996155 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88babb70-b184-4246-8adf-ebf56451fba2 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:58.014570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49dd82-d2f0-4cbf-a26d-4f8d7db28fc2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n__Tb4JLRJOgt_dzpgHEjw, audit_chain_id=['n__Tb4JLRJOgt_dzpgHEjw']) at 0x7f8a0fe7f310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:58.015212 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49dd82-d2f0-4cbf-a26d-4f8d7db28fc2 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:58.015482 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49dd82-d2f0-4cbf-a26d-4f8d7db28fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:58.016009 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49dd82-d2f0-4cbf-a26d-4f8d7db28fc2 None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:58.016725 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49dd82-d2f0-4cbf-a26d-4f8d7db28fc2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:58.017030 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49dd82-d2f0-4cbf-a26d-4f8d7db28fc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:58.018419 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49dd82-d2f0-4cbf-a26d-4f8d7db28fc2 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:58.020216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:58.033319 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 212/431] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:47:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:58.034732 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ee05e-8a21-4814-8a1d-25ba4a79f840 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:58.035020 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ee05e-8a21-4814-8a1d-25ba4a79f840 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:58.035298 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ee05e-8a21-4814-8a1d-25ba4a79f840 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:58.040265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 213/432] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:58.040265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ee05e-8a21-4814-8a1d-25ba4a79f840 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:58.110576 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88babb70-b184-4246-8adf-ebf56451fba2 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:58.146366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a18e80-08ae-4568-87c7-3380852fee6c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=DSjqtvGOQHKPr97PnNqhQQ, audit_chain_id=['DSjqtvGOQHKPr97PnNqhQQ']) at 0x7f8a0fe465e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:58.147012 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a18e80-08ae-4568-87c7-3380852fee6c None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:58.147300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a18e80-08ae-4568-87c7-3380852fee6c None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:58.147578 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a18e80-08ae-4568-87c7-3380852fee6c None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:58.148274 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ee05e-8a21-4814-8a1d-25ba4a79f840 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:58.148760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a18e80-08ae-4568-87c7-3380852fee6c None admin] RBAC: Authorizing `identity:get_project(project_id=c312d273f41543edafc129654a960b7b)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:58.150252 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a18e80-08ae-4568-87c7-3380852fee6c None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:58.152112 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 220/433] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:57 2022] GET /identity/v3/projects/c312d273f41543edafc129654a960b7b => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:58.152693 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a18e80-08ae-4568-87c7-3380852fee6c None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:58.168210 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:58.184130 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620d6a6-1b5b-48bc-8bdc-68a40192eee9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3A8rqVKyT3-lLN1N4JHI6A, audit_chain_id=['3A8rqVKyT3-lLN1N4JHI6A']) at 0x7f8a0fe991f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:58.184753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d6a6-1b5b-48bc-8bdc-68a40192eee9 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:58.185036 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d6a6-1b5b-48bc-8bdc-68a40192eee9 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:58.185310 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d6a6-1b5b-48bc-8bdc-68a40192eee9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:58.186127 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620d6a6-1b5b-48bc-8bdc-68a40192eee9 None admin] RBAC: Adding query filter params (group.id=e5635de691fc441fa29c0dc84457730e, role.id=c57f45d724fe45009701c9b2706d661c, scope.project.id=fa144b85a37b4dd191df360058c783d1) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:58.186441 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620d6a6-1b5b-48bc-8bdc-68a40192eee9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:58.187865 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620d6a6-1b5b-48bc-8bdc-68a40192eee9 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:58.193922 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 214/434] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Jul 25 22:47:58 2022] GET /identity/v3/role_assignments?group.id=e5635de691fc441fa29c0dc84457730e&scope.project.id=fa144b85a37b4dd191df360058c783d1&role.id=c57f45d724fe45009701c9b2706d661c => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:58.194912 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e4431-c71d-4a28-8d6d-e77e0a92f54d None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:58.195199 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e4431-c71d-4a28-8d6d-e77e0a92f54d None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:58.195471 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e4431-c71d-4a28-8d6d-e77e0a92f54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:58.214944 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-6a8e4431-c71d-4a28-8d6d-e77e0a92f54d None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:58.216179 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-6a8e4431-c71d-4a28-8d6d-e77e0a92f54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:58.282926 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a18e80-08ae-4568-87c7-3380852fee6c None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:58.283186 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:58.297261 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 215/435] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:58.298977 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5ddc1-2161-4876-8866-3a01da4a5c58 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:58.299332 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5ddc1-2161-4876-8866-3a01da4a5c58 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:58.299687 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5ddc1-2161-4876-8866-3a01da4a5c58 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:58.305138 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 216/436] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:58.305138 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5ddc1-2161-4876-8866-3a01da4a5c58 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:58.335240 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5559b9-c088-4763-aceb-e6f106b0efbc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n__Tb4JLRJOgt_dzpgHEjw, audit_chain_id=['n__Tb4JLRJOgt_dzpgHEjw']) at 0x7f8a0fdc4430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:58.335873 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5559b9-c088-4763-aceb-e6f106b0efbc None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:58.336158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5559b9-c088-4763-aceb-e6f106b0efbc None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:58.336436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5559b9-c088-4763-aceb-e6f106b0efbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:58.416043 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5559b9-c088-4763-aceb-e6f106b0efbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:58.418310 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5559b9-c088-4763-aceb-e6f106b0efbc None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:58.435219 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:58.437551 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5ddc1-2161-4876-8866-3a01da4a5c58 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:58.478974 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9048f-a940-4d8c-ada7-81ff545c94f1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=DSjqtvGOQHKPr97PnNqhQQ, audit_chain_id=['DSjqtvGOQHKPr97PnNqhQQ']) at 0x7f8a0fe07e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:58.479933 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9048f-a940-4d8c-ada7-81ff545c94f1 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:58.481059 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9048f-a940-4d8c-ada7-81ff545c94f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:58.481526 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9048f-a940-4d8c-ada7-81ff545c94f1 None admin] PATH_INFO: `/v3/groups/e5635de691fc441fa29c0dc84457730e` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:58.482826 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9048f-a940-4d8c-ada7-81ff545c94f1 None admin] RBAC: Authorizing `identity:get_group(group_id=e5635de691fc441fa29c0dc84457730e)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:58.484280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9048f-a940-4d8c-ada7-81ff545c94f1 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:58.485878 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 217/437] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 22:47:58 2022] GET /identity/v3/groups/e5635de691fc441fa29c0dc84457730e => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:58.487061 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51652af5-030b-48d9-b023-8da82d6118d1 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:58.487363 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51652af5-030b-48d9-b023-8da82d6118d1 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:58.487622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51652af5-030b-48d9-b023-8da82d6118d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:58.505658 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-51652af5-030b-48d9-b023-8da82d6118d1 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:58.506832 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-51652af5-030b-48d9-b023-8da82d6118d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:58.527984 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 221/438] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:58.528931 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5559b9-c088-4763-aceb-e6f106b0efbc None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:58.562293 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:58.577032 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 218/439] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:47:58.577982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51652af5-030b-48d9-b023-8da82d6118d1 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:58.631237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5559b9-c088-4763-aceb-e6f106b0efbc None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:58.645768 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:58.672545 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5156f97-23a4-43ec-bc33-ea5b53708193 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r5TpzQ3mQEWo8cpPDLIJAg, audit_chain_id=['r5TpzQ3mQEWo8cpPDLIJAg']) at 0x7f8a141365b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:58.673107 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5156f97-23a4-43ec-bc33-ea5b53708193 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:58.673393 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5156f97-23a4-43ec-bc33-ea5b53708193 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:58.673710 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5156f97-23a4-43ec-bc33-ea5b53708193 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:58.685423 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5156f97-23a4-43ec-bc33-ea5b53708193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:58.689083 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51652af5-030b-48d9-b023-8da82d6118d1 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:58.690387 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-d5156f97-23a4-43ec-bc33-ea5b53708193 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:58.690387 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:58.690387 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:58.690387 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:58.690387 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:58.690387 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:58.690387 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:58.690387 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:58.690387 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:58.690387 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:58.690387 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:58.690387 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:58.690387 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:58.690387 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:58.690387 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:58.690387 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:58.691250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:58.691250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:58.691250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:58.691250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:58.691250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:58.691250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:58.691250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:58.691250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:58.691250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:58.691250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:58.691250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:58.691250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:58.691250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:58.691250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:58.691250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:58.691250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:58.692036 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:58.692036 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:58.692036 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:58.692036 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:58.692036 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:58.692036 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:58.692036 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:58.692036 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:58.692036 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:58.692036 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:58.692036 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:47:58.692036 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:47:58.692036 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 222/440] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:47:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:58.692693 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5156f97-23a4-43ec-bc33-ea5b53708193 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:58.724407 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad1d87-7244-4e68-948b-12b5bfe76658 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=DSjqtvGOQHKPr97PnNqhQQ, audit_chain_id=['DSjqtvGOQHKPr97PnNqhQQ']) at 0x7f8a0fefdf40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:58.725029 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad1d87-7244-4e68-948b-12b5bfe76658 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:58.725312 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad1d87-7244-4e68-948b-12b5bfe76658 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:58.725600 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad1d87-7244-4e68-948b-12b5bfe76658 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:58.726467 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad1d87-7244-4e68-948b-12b5bfe76658 None admin] RBAC: Adding query filter params (group.id=e5635de691fc441fa29c0dc84457730e, role.id=c57f45d724fe45009701c9b2706d661c, scope.project.id=c312d273f41543edafc129654a960b7b) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:58.726776 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad1d87-7244-4e68-948b-12b5bfe76658 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:58.728188 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad1d87-7244-4e68-948b-12b5bfe76658 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:58.734962 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 219/441] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Jul 25 22:47:58 2022] GET /identity/v3/role_assignments?group.id=e5635de691fc441fa29c0dc84457730e&scope.project.id=c312d273f41543edafc129654a960b7b&role.id=c57f45d724fe45009701c9b2706d661c => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:58.735906 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad1d87-7244-4e68-948b-12b5bfe76658 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:58.797657 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:58.804825 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5156f97-23a4-43ec-bc33-ea5b53708193 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:58.845290 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064849e-b84e-470e-bec7-bccc81330eca None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n__Tb4JLRJOgt_dzpgHEjw, audit_chain_id=['n__Tb4JLRJOgt_dzpgHEjw']) at 0x7f8a0fdc4e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:58.845892 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064849e-b84e-470e-bec7-bccc81330eca None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:58.846177 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064849e-b84e-470e-bec7-bccc81330eca None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:58.846454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064849e-b84e-470e-bec7-bccc81330eca None admin] PATH_INFO: `/v3/projects/c312d273f41543edafc129654a960b7b` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:58.847699 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064849e-b84e-470e-bec7-bccc81330eca None admin] RBAC: Authorizing `identity:get_project(project_id=c312d273f41543edafc129654a960b7b)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:58.849173 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064849e-b84e-470e-bec7-bccc81330eca None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:58.851072 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 223/442] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:58 2022] GET /identity/v3/projects/c312d273f41543edafc129654a960b7b => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:58.851703 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064849e-b84e-470e-bec7-bccc81330eca None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:58.859043 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad1d87-7244-4e68-948b-12b5bfe76658 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:58.898484 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078470dc-50cb-4a7f-b188-d354e8e8b3b9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SAhlvxgYRDyyGuXdPqVQeg, audit_chain_id=['SAhlvxgYRDyyGuXdPqVQeg']) at 0x7f8a0fe6dfd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:58.899154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078470dc-50cb-4a7f-b188-d354e8e8b3b9 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:58.899441 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078470dc-50cb-4a7f-b188-d354e8e8b3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:58.899721 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078470dc-50cb-4a7f-b188-d354e8e8b3b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:58.906265 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:58.917377 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078470dc-50cb-4a7f-b188-d354e8e8b3b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:47:58.923013 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-078470dc-50cb-4a7f-b188-d354e8e8b3b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:47:58.923013 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:47:58.923013 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:47:58.923013 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:47:58.923013 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:47:58.923013 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:47:58.923013 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:47:58.923013 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:47:58.923013 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:47:58.923013 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:47:58.923013 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:47:58.923013 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:47:58.923013 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:47:58.923013 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:47:58.923013 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:47:58.923013 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:47:58.923929 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:47:58.923929 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:47:58.923929 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:47:58.923929 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:47:58.923929 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:47:58.923929 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:47:58.923929 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:47:58.923929 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:47:58.923929 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:47:58.923929 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:47:58.923929 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:47:58.923929 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:47:58.923929 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:47:58.923929 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:47:58.923929 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:47:58.923929 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:47:58.925016 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:47:58.925016 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:47:58.925016 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:47:58.925016 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:47:58.925016 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:47:58.925016 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:47:58.925016 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:47:58.925016 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:47:58.925016 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:47:58.925016 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:47:58.925016 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:47:58.925016 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:47:58.925016 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 220/443] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 22:47:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:47:58.925016 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078470dc-50cb-4a7f-b188-d354e8e8b3b9 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:58.977566 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064849e-b84e-470e-bec7-bccc81330eca None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:59.015518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a947f-f6f0-4851-8f62-a9c63bab6a08 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r5TpzQ3mQEWo8cpPDLIJAg, audit_chain_id=['r5TpzQ3mQEWo8cpPDLIJAg']) at 0x7f8a0fe138b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:59.016582 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a947f-f6f0-4851-8f62-a9c63bab6a08 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:59.016865 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a947f-f6f0-4851-8f62-a9c63bab6a08 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:59.017142 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a947f-f6f0-4851-8f62-a9c63bab6a08 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:59.017949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a947f-f6f0-4851-8f62-a9c63bab6a08 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:59.018212 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a947f-f6f0-4851-8f62-a9c63bab6a08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:59.019599 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a947f-f6f0-4851-8f62-a9c63bab6a08 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:59.029856 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 224/444] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:47:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:59.030702 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a947f-f6f0-4851-8f62-a9c63bab6a08 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:59.050073 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078470dc-50cb-4a7f-b188-d354e8e8b3b9 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:59.068855 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:59.097695 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714f100-8ad7-40f4-af5e-7bdd444f5dc0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n__Tb4JLRJOgt_dzpgHEjw, audit_chain_id=['n__Tb4JLRJOgt_dzpgHEjw']) at 0x7f8a0fdd5d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:59.098292 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714f100-8ad7-40f4-af5e-7bdd444f5dc0 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:59.098585 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714f100-8ad7-40f4-af5e-7bdd444f5dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:59.098866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714f100-8ad7-40f4-af5e-7bdd444f5dc0 None admin] PATH_INFO: `/v3/groups/e5635de691fc441fa29c0dc84457730e` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:59.100051 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714f100-8ad7-40f4-af5e-7bdd444f5dc0 None admin] RBAC: Authorizing `identity:get_group(group_id=e5635de691fc441fa29c0dc84457730e)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:59.101487 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714f100-8ad7-40f4-af5e-7bdd444f5dc0 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:59.103131 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 221/445] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 22:47:58 2022] GET /identity/v3/groups/e5635de691fc441fa29c0dc84457730e => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:59.103912 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714f100-8ad7-40f4-af5e-7bdd444f5dc0 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:59.153288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a947f-f6f0-4851-8f62-a9c63bab6a08 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:59.156347 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:59.187720 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99917bf0-a9fa-4ef6-b326-28c6cea93178 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SAhlvxgYRDyyGuXdPqVQeg, audit_chain_id=['SAhlvxgYRDyyGuXdPqVQeg']) at 0x7f8a0fdcf370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:59.188651 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99917bf0-a9fa-4ef6-b326-28c6cea93178 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:59.188944 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99917bf0-a9fa-4ef6-b326-28c6cea93178 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:59.189220 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99917bf0-a9fa-4ef6-b326-28c6cea93178 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:59.189968 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99917bf0-a9fa-4ef6-b326-28c6cea93178 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:59.190276 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99917bf0-a9fa-4ef6-b326-28c6cea93178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:59.191667 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99917bf0-a9fa-4ef6-b326-28c6cea93178 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:59.200590 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 225/446] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:47:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:59.201386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99917bf0-a9fa-4ef6-b326-28c6cea93178 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:59.217245 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714f100-8ad7-40f4-af5e-7bdd444f5dc0 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:59.251371 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113488a9-3146-410b-840b-3950fa5adeef None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r5TpzQ3mQEWo8cpPDLIJAg, audit_chain_id=['r5TpzQ3mQEWo8cpPDLIJAg']) at 0x7f8a0fdd5460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:59.251982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113488a9-3146-410b-840b-3950fa5adeef None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:59.252265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113488a9-3146-410b-840b-3950fa5adeef None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:59.252538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113488a9-3146-410b-840b-3950fa5adeef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:59.300439 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:59.307181 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99917bf0-a9fa-4ef6-b326-28c6cea93178 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:59.320429 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113488a9-3146-410b-840b-3950fa5adeef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:59.321938 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113488a9-3146-410b-840b-3950fa5adeef None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:59.345089 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f93d0-131a-46c0-892b-124f9d06ab68 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n__Tb4JLRJOgt_dzpgHEjw, audit_chain_id=['n__Tb4JLRJOgt_dzpgHEjw']) at 0x7f8a14135550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:59.345752 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f93d0-131a-46c0-892b-124f9d06ab68 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:59.346035 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f93d0-131a-46c0-892b-124f9d06ab68 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:59.346312 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f93d0-131a-46c0-892b-124f9d06ab68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:59.347094 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f93d0-131a-46c0-892b-124f9d06ab68 None admin] RBAC: Adding query filter params (group.id=e5635de691fc441fa29c0dc84457730e, role.id=e0342a5e42664f35948f522071411514, scope.project.id=c312d273f41543edafc129654a960b7b) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:59.347395 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f93d0-131a-46c0-892b-124f9d06ab68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:59.348899 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f93d0-131a-46c0-892b-124f9d06ab68 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:59.354616 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 226/447] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Jul 25 22:47:59 2022] GET /identity/v3/role_assignments?group.id=e5635de691fc441fa29c0dc84457730e&scope.project.id=c312d273f41543edafc129654a960b7b&role.id=e0342a5e42664f35948f522071411514 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:47:59.356040 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f93d0-131a-46c0-892b-124f9d06ab68 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:59.403605 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:59.447968 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 222/448] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:59.454392 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113488a9-3146-410b-840b-3950fa5adeef None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:59.490614 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f93d0-131a-46c0-892b-124f9d06ab68 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:59.530802 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a636f-1255-40af-baba-2e62bb87e6e9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SAhlvxgYRDyyGuXdPqVQeg, audit_chain_id=['SAhlvxgYRDyyGuXdPqVQeg']) at 0x7f8a141400a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:59.531731 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a636f-1255-40af-baba-2e62bb87e6e9 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:59.532018 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a636f-1255-40af-baba-2e62bb87e6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:59.532289 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a636f-1255-40af-baba-2e62bb87e6e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:59.551554 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:59.574625 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113488a9-3146-410b-840b-3950fa5adeef None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:59.617246 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a636f-1255-40af-baba-2e62bb87e6e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:59.618672 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a636f-1255-40af-baba-2e62bb87e6e9 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:59.618930 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25992760-43f8-430c-aeb8-7c5b1ac5a101 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r5TpzQ3mQEWo8cpPDLIJAg, audit_chain_id=['r5TpzQ3mQEWo8cpPDLIJAg']) at 0x7f8a0fe32460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:59.619583 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25992760-43f8-430c-aeb8-7c5b1ac5a101 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:59.619863 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25992760-43f8-430c-aeb8-7c5b1ac5a101 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:59.620135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25992760-43f8-430c-aeb8-7c5b1ac5a101 None admin] PATH_INFO: `/v3/projects/fa144b85a37b4dd191df360058c783d1` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:59.626511 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25992760-43f8-430c-aeb8-7c5b1ac5a101 None admin] RBAC: Authorizing `identity:get_project(project_id=fa144b85a37b4dd191df360058c783d1)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:59.628161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25992760-43f8-430c-aeb8-7c5b1ac5a101 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:59.629943 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 223/449] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:59 2022] GET /identity/v3/projects/fa144b85a37b4dd191df360058c783d1 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:59.635396 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25992760-43f8-430c-aeb8-7c5b1ac5a101 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:59.657567 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:59.749756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 227/450] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:47:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:47:59.755350 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a636f-1255-40af-baba-2e62bb87e6e9 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:59.764551 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25992760-43f8-430c-aeb8-7c5b1ac5a101 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:59.807193 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8ef38-595a-47f0-a6c0-dacf4a5a7e45 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r5TpzQ3mQEWo8cpPDLIJAg, audit_chain_id=['r5TpzQ3mQEWo8cpPDLIJAg']) at 0x7f8a0fdd2d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:59.808856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8ef38-595a-47f0-a6c0-dacf4a5a7e45 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:59.809028 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8ef38-595a-47f0-a6c0-dacf4a5a7e45 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:59.809283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8ef38-595a-47f0-a6c0-dacf4a5a7e45 None admin] PATH_INFO: `/v3/groups/e5635de691fc441fa29c0dc84457730e` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:59.810637 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8ef38-595a-47f0-a6c0-dacf4a5a7e45 None admin] RBAC: Authorizing `identity:get_group(group_id=e5635de691fc441fa29c0dc84457730e)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:59.812197 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8ef38-595a-47f0-a6c0-dacf4a5a7e45 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:59.813826 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 224/451] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 22:47:59 2022] GET /identity/v3/groups/e5635de691fc441fa29c0dc84457730e => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:59.819813 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8ef38-595a-47f0-a6c0-dacf4a5a7e45 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:59.841498 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:59.873525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a636f-1255-40af-baba-2e62bb87e6e9 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:59.910481 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:59.917093 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750803a-ec4d-4d60-96ce-063212736c62 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SAhlvxgYRDyyGuXdPqVQeg, audit_chain_id=['SAhlvxgYRDyyGuXdPqVQeg']) at 0x7f8a0fe3f250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:59.917970 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750803a-ec4d-4d60-96ce-063212736c62 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:59.918368 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750803a-ec4d-4d60-96ce-063212736c62 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:59.918565 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750803a-ec4d-4d60-96ce-063212736c62 None admin] PATH_INFO: `/v3/projects/bbcbafb1154a42cbb08b02e29c87618d` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:59.919748 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750803a-ec4d-4d60-96ce-063212736c62 None admin] RBAC: Authorizing `identity:get_project(project_id=bbcbafb1154a42cbb08b02e29c87618d)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:59.921201 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750803a-ec4d-4d60-96ce-063212736c62 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:59.922909 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 228/452] 10.222.0.47 () {56 vars in 1186 bytes} [Mon Jul 25 22:47:59 2022] GET /identity/v3/projects/bbcbafb1154a42cbb08b02e29c87618d => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:47:59.928383 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750803a-ec4d-4d60-96ce-063212736c62 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:59.936970 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8ef38-595a-47f0-a6c0-dacf4a5a7e45 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:59.971514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac485c-321f-44d4-be46-985c2501cf11 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r5TpzQ3mQEWo8cpPDLIJAg, audit_chain_id=['r5TpzQ3mQEWo8cpPDLIJAg']) at 0x7f8a0fe3b0d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:59.972134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac485c-321f-44d4-be46-985c2501cf11 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:59.972419 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac485c-321f-44d4-be46-985c2501cf11 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:59.972696 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac485c-321f-44d4-be46-985c2501cf11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:59.973507 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac485c-321f-44d4-be46-985c2501cf11 None admin] RBAC: Adding query filter params (group.id=e5635de691fc441fa29c0dc84457730e, role.id=e0342a5e42664f35948f522071411514, scope.project.id=fa144b85a37b4dd191df360058c783d1) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:47:59.973927 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac485c-321f-44d4-be46-985c2501cf11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:59.975379 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac485c-321f-44d4-be46-985c2501cf11 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:59.981811 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 225/453] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Jul 25 22:47:59 2022] GET /identity/v3/role_assignments?group.id=e5635de691fc441fa29c0dc84457730e&scope.project.id=fa144b85a37b4dd191df360058c783d1&role.id=e0342a5e42664f35948f522071411514 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:00.037525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750803a-ec4d-4d60-96ce-063212736c62 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:00.075821 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cb814-ca3f-4a97-ac2f-60cb506eaffb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SAhlvxgYRDyyGuXdPqVQeg, audit_chain_id=['SAhlvxgYRDyyGuXdPqVQeg']) at 0x7f8a140d1640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:00.076486 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cb814-ca3f-4a97-ac2f-60cb506eaffb None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:00.076779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cb814-ca3f-4a97-ac2f-60cb506eaffb None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:00.077089 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cb814-ca3f-4a97-ac2f-60cb506eaffb None admin] PATH_INFO: `/v3/groups/e27122c162e944c5ba6aed041c438ccd` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:00.078332 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cb814-ca3f-4a97-ac2f-60cb506eaffb None admin] RBAC: Authorizing `identity:get_group(group_id=e27122c162e944c5ba6aed041c438ccd)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:00.079807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cb814-ca3f-4a97-ac2f-60cb506eaffb None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:00.081411 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 229/454] 10.222.0.47 () {56 vars in 1180 bytes} [Mon Jul 25 22:47:59 2022] GET /identity/v3/groups/e27122c162e944c5ba6aed041c438ccd => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:00.087480 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac485c-321f-44d4-be46-985c2501cf11 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:00.173224 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:00.194076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac485c-321f-44d4-be46-985c2501cf11 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:00.233295 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b8dcc-ebd9-4055-95c4-8ea89df4e6de None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=SAhlvxgYRDyyGuXdPqVQeg, audit_chain_id=['SAhlvxgYRDyyGuXdPqVQeg']) at 0x7f8a0fe935e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:00.233956 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b8dcc-ebd9-4055-95c4-8ea89df4e6de None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:00.234247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b8dcc-ebd9-4055-95c4-8ea89df4e6de None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:00.234522 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b8dcc-ebd9-4055-95c4-8ea89df4e6de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:00.235342 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b8dcc-ebd9-4055-95c4-8ea89df4e6de None admin] RBAC: Adding query filter params (group.id=e27122c162e944c5ba6aed041c438ccd, role.id=6ca03befbf3a456eae350bc7e583488f, scope.project.id=bbcbafb1154a42cbb08b02e29c87618d) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:00.235656 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b8dcc-ebd9-4055-95c4-8ea89df4e6de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:00.237098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b8dcc-ebd9-4055-95c4-8ea89df4e6de None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:00.243526 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 226/455] 10.222.0.47 () {56 vars in 1376 bytes} [Mon Jul 25 22:48:00 2022] GET /identity/v3/role_assignments?group.id=e27122c162e944c5ba6aed041c438ccd&scope.project.id=bbcbafb1154a42cbb08b02e29c87618d&role.id=6ca03befbf3a456eae350bc7e583488f => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:02.756244 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa18c58-999f-4086-a9d3-3afe2d04834c None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:02.756753 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa18c58-999f-4086-a9d3-3afe2d04834c None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:02.756829 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa18c58-999f-4086-a9d3-3afe2d04834c None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:02.758391 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 230/456] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:02.763815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510efc9-5ebb-41fa-8f41-9cbff6aa37e9 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:02.764223 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510efc9-5ebb-41fa-8f41-9cbff6aa37e9 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:02.764409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510efc9-5ebb-41fa-8f41-9cbff6aa37e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:02.783677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-8510efc9-5ebb-41fa-8f41-9cbff6aa37e9 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:02.784875 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-8510efc9-5ebb-41fa-8f41-9cbff6aa37e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:02.862998 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 227/457] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:48:02.887811 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa18c58-999f-4086-a9d3-3afe2d04834c None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:02.961442 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:02.962491 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a668f-df65-4cf3-9912-c95500aaf0df None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:02.962791 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a668f-df65-4cf3-9912-c95500aaf0df None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:02.963075 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a668f-df65-4cf3-9912-c95500aaf0df None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:02.966416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 228/458] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:02.970796 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0c924-83dc-4884-a6e7-20c3452866e5 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:02.971340 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0c924-83dc-4884-a6e7-20c3452866e5 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:02.971817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0c924-83dc-4884-a6e7-20c3452866e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:02.990972 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-dfb0c924-83dc-4884-a6e7-20c3452866e5 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:02.992621 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-dfb0c924-83dc-4884-a6e7-20c3452866e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:03.003194 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa18c58-999f-4086-a9d3-3afe2d04834c None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:03.046053 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83b847-1284-4ced-be29-f7bb3b9d8454 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ml4TnSyARryX91wrAQMXiQ, audit_chain_id=['Ml4TnSyARryX91wrAQMXiQ']) at 0x7f8a140b9b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:03.046394 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83b847-1284-4ced-be29-f7bb3b9d8454 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:03.046672 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83b847-1284-4ced-be29-f7bb3b9d8454 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:03.046952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83b847-1284-4ced-be29-f7bb3b9d8454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:03.059003 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83b847-1284-4ced-be29-f7bb3b9d8454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:03.060472 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83b847-1284-4ced-be29-f7bb3b9d8454 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:03.073488 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 229/459] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:48:03.077424 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-4b83b847-1284-4ced-be29-f7bb3b9d8454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:03.077424 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:03.077424 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:03.077424 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:03.077424 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:03.077424 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:03.077424 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:03.077424 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:03.077424 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:03.077424 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:03.077424 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:03.077424 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:03.077424 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:03.077424 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:03.077424 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:03.078435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:03.078435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:03.078435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:03.078435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:03.078435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:03.078435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:03.078435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:03.078435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:03.078435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:03.078435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:03.078435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:03.078435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:03.078435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:03.078435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:03.078435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:03.078435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:03.078435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:03.079297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:03.079297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:03.079297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:03.079297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:03.079297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 231/460] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:03.085709 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0c924-83dc-4884-a6e7-20c3452866e5 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:03.088756 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:03.099185 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83b847-1284-4ced-be29-f7bb3b9d8454 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:03.209678 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0c924-83dc-4884-a6e7-20c3452866e5 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:03.211399 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83b847-1284-4ced-be29-f7bb3b9d8454 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:03.230364 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:03.248125 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e4d0b-5d53-4e1a-8650-80767341a879 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ml4TnSyARryX91wrAQMXiQ, audit_chain_id=['Ml4TnSyARryX91wrAQMXiQ']) at 0x7f8a0fe932e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:03.248759 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e4d0b-5d53-4e1a-8650-80767341a879 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:03.249045 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e4d0b-5d53-4e1a-8650-80767341a879 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:03.249324 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e4d0b-5d53-4e1a-8650-80767341a879 None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:03.249650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e591267-dba4-4a2c-be52-62063e083868 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r5VO4UIlTXakH8KbSlsDEA, audit_chain_id=['r5VO4UIlTXakH8KbSlsDEA']) at 0x7f8a0fddec40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:03.250058 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e4d0b-5d53-4e1a-8650-80767341a879 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:03.250297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e591267-dba4-4a2c-be52-62063e083868 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:03.250394 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e4d0b-5d53-4e1a-8650-80767341a879 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:03.250582 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e591267-dba4-4a2c-be52-62063e083868 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:03.250863 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e591267-dba4-4a2c-be52-62063e083868 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:03.251843 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e4d0b-5d53-4e1a-8650-80767341a879 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:03.264457 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e591267-dba4-4a2c-be52-62063e083868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:03.270234 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 230/461] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:03.270424 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e591267-dba4-4a2c-be52-62063e083868 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:03.270501 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f76dd0-d2ac-4f10-984d-52345d1a0d48 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:03.270501 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f76dd0-d2ac-4f10-984d-52345d1a0d48 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:03.270501 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f76dd0-d2ac-4f10-984d-52345d1a0d48 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:03.270501 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 231/462] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:03.273924 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f76dd0-d2ac-4f10-984d-52345d1a0d48 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:03.286151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-5e591267-dba4-4a2c-be52-62063e083868 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:03.286151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:03.286151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:03.286151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:03.286151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:03.286151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:03.286151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:03.286151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:03.286151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:03.286151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:03.286151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:03.286151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:03.286151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:03.286151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:03.286151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:03.287105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:03.287105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:03.287105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:03.287105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:03.287105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:03.287105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:03.287105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:03.287105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:03.287105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:03.287105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:03.287105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:03.287105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:03.287105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:03.287105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:03.287105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:03.287105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:03.287105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:03.288020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:03.288020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:03.288020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:03.288020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:03.289916 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 232/463] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:48:03.293139 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b83a4-16a7-44a6-9f75-6e3bb011cc61 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:03.293442 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b83a4-16a7-44a6-9f75-6e3bb011cc61 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:03.293769 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b83a4-16a7-44a6-9f75-6e3bb011cc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:03.314678 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-e57b83a4-16a7-44a6-9f75-6e3bb011cc61 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:03.315813 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-e57b83a4-16a7-44a6-9f75-6e3bb011cc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:03.347414 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:03.390961 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f76dd0-d2ac-4f10-984d-52345d1a0d48 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:03.398395 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 233/464] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:48:03.398395 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b83a4-16a7-44a6-9f75-6e3bb011cc61 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:03.433313 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57cc59-9ed1-4213-b48d-8cc779ba2e2d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ml4TnSyARryX91wrAQMXiQ, audit_chain_id=['Ml4TnSyARryX91wrAQMXiQ']) at 0x7f8a0fe94fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:03.433968 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57cc59-9ed1-4213-b48d-8cc779ba2e2d None admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:03.434255 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57cc59-9ed1-4213-b48d-8cc779ba2e2d None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:03.434534 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57cc59-9ed1-4213-b48d-8cc779ba2e2d None admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:03.435225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57cc59-9ed1-4213-b48d-8cc779ba2e2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:03.436661 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57cc59-9ed1-4213-b48d-8cc779ba2e2d None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:03.457614 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 232/465] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 22:48:03 2022] POST /identity/v3/users => generated 246 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:48:03.463146 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bf228-db2d-43c2-9572-c5a496fdc859 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:03.463547 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bf228-db2d-43c2-9572-c5a496fdc859 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:03.463814 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bf228-db2d-43c2-9572-c5a496fdc859 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:03.466087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 233/466] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:03.466894 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bf228-db2d-43c2-9572-c5a496fdc859 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:03.527535 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:03.531111 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b83a4-16a7-44a6-9f75-6e3bb011cc61 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:03.580271 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f8cdb-80d4-4e75-87d7-fcbc4d9535bd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r5VO4UIlTXakH8KbSlsDEA, audit_chain_id=['r5VO4UIlTXakH8KbSlsDEA']) at 0x7f8a0fdc0910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:03.581145 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f8cdb-80d4-4e75-87d7-fcbc4d9535bd None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:03.581609 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f8cdb-80d4-4e75-87d7-fcbc4d9535bd None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:03.581902 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f8cdb-80d4-4e75-87d7-fcbc4d9535bd None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:03.582804 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f8cdb-80d4-4e75-87d7-fcbc4d9535bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:03.583114 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f8cdb-80d4-4e75-87d7-fcbc4d9535bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:03.584671 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f8cdb-80d4-4e75-87d7-fcbc4d9535bd None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:03.590284 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bf228-db2d-43c2-9572-c5a496fdc859 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:03.604572 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 234/467] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:03.611215 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548f777-8a50-401c-ae64-4cd0742b4e39 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:03.611541 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548f777-8a50-401c-ae64-4cd0742b4e39 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:03.611786 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548f777-8a50-401c-ae64-4cd0742b4e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:03.614183 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:03.630945 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f3b5d-aa24-4c73-85a0-c5fc3d3f3df0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Pw89p1avStG-DhwekHTTdA, audit_chain_id=['Pw89p1avStG-DhwekHTTdA']) at 0x7f8a0fe7fc40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:03.631313 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-1548f777-8a50-401c-ae64-4cd0742b4e39 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:03.631600 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f3b5d-aa24-4c73-85a0-c5fc3d3f3df0 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:03.631878 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f3b5d-aa24-4c73-85a0-c5fc3d3f3df0 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:03.632489 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-1548f777-8a50-401c-ae64-4cd0742b4e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:03.632843 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f3b5d-aa24-4c73-85a0-c5fc3d3f3df0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:03.647125 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f3b5d-aa24-4c73-85a0-c5fc3d3f3df0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:03.648585 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f3b5d-aa24-4c73-85a0-c5fc3d3f3df0 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:03.664620 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-2c9f3b5d-aa24-4c73-85a0-c5fc3d3f3df0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:03.664620 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:03.664620 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:03.664620 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:03.664620 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:03.664620 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:03.664620 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:03.664620 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:03.664620 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:03.664620 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:03.664620 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:03.664620 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:03.664620 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:03.664620 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:03.664620 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:03.665487 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:03.665487 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:03.665487 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:03.665487 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:03.665487 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:03.665487 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:03.665487 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:03.665487 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:03.665487 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:03.665487 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:03.665487 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:03.665487 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:03.665487 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:03.665487 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:03.665487 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:03.665487 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:03.665487 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:03.666371 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:03.666371 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:03.666371 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:03.666371 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:03.666371 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 234/468] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:03.666930 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f3b5d-aa24-4c73-85a0-c5fc3d3f3df0 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:03.714322 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 235/469] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:48:03.715877 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548f777-8a50-401c-ae64-4cd0742b4e39 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:03.776690 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f3b5d-aa24-4c73-85a0-c5fc3d3f3df0 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:03.816443 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:03.816986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7923bb-6124-4b9c-83e8-66c9aa80fa00 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r5VO4UIlTXakH8KbSlsDEA, audit_chain_id=['r5VO4UIlTXakH8KbSlsDEA']) at 0x7f8a0fdd9ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:03.817097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7923bb-6124-4b9c-83e8-66c9aa80fa00 None admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:03.817360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7923bb-6124-4b9c-83e8-66c9aa80fa00 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:03.817663 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7923bb-6124-4b9c-83e8-66c9aa80fa00 None admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:03.818345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7923bb-6124-4b9c-83e8-66c9aa80fa00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:03.819781 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7923bb-6124-4b9c-83e8-66c9aa80fa00 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:03.829427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548f777-8a50-401c-ae64-4cd0742b4e39 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:03.853689 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 235/470] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 22:48:03 2022] POST /identity/v3/users => generated 248 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:48:03.853689 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7923bb-6124-4b9c-83e8-66c9aa80fa00 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:03.882294 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c9869-b89a-48fe-ba94-956cad27c55d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Pw89p1avStG-DhwekHTTdA, audit_chain_id=['Pw89p1avStG-DhwekHTTdA']) at 0x7f8a150e6ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:03.883029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c9869-b89a-48fe-ba94-956cad27c55d None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:03.883336 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c9869-b89a-48fe-ba94-956cad27c55d None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:03.883659 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c9869-b89a-48fe-ba94-956cad27c55d None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:03.884408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c9869-b89a-48fe-ba94-956cad27c55d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:03.884791 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c9869-b89a-48fe-ba94-956cad27c55d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:03.886580 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c9869-b89a-48fe-ba94-956cad27c55d None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:03.889893 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:03.906260 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 236/471] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:03.914873 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c9869-b89a-48fe-ba94-956cad27c55d None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:03.990499 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7923bb-6124-4b9c-83e8-66c9aa80fa00 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:04.038450 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693f82f-9d90-4ddd-afa2-5a89125860da None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4pNHIxJCRzOx6FPaTyaEgg, audit_chain_id=['4pNHIxJCRzOx6FPaTyaEgg']) at 0x7f8a0fe1e850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:04.039485 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693f82f-9d90-4ddd-afa2-5a89125860da None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:04.040170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693f82f-9d90-4ddd-afa2-5a89125860da None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:04.040514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693f82f-9d90-4ddd-afa2-5a89125860da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:04.052890 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c9869-b89a-48fe-ba94-956cad27c55d None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:04.053726 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693f82f-9d90-4ddd-afa2-5a89125860da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:04.055459 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693f82f-9d90-4ddd-afa2-5a89125860da None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:04.071098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-2693f82f-9d90-4ddd-afa2-5a89125860da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:04.071098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:04.071098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:04.071098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:04.071098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:04.071098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:04.071098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:04.071098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:04.071098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:04.071098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:04.071098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:04.071098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:04.071098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:04.071098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:04.071098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:04.072015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:04.072015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:04.072015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:04.072015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:04.072015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:04.072015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:04.072015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:04.072015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:04.072015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:04.072015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:04.072015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:04.072015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:04.072015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:04.072015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:04.072015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:04.072015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:04.072015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:04.075004 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:04.075004 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:04.075004 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:04.075004 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:04.078198 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 236/472] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:04.079538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693f82f-9d90-4ddd-afa2-5a89125860da None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:04.096976 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb9afe-3153-45c8-9c58-f9bb58cb9d1d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Pw89p1avStG-DhwekHTTdA, audit_chain_id=['Pw89p1avStG-DhwekHTTdA']) at 0x7f8a0fdc1cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:04.097637 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb9afe-3153-45c8-9c58-f9bb58cb9d1d None admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:04.097928 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb9afe-3153-45c8-9c58-f9bb58cb9d1d None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:04.098206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb9afe-3153-45c8-9c58-f9bb58cb9d1d None admin] PATH_INFO: `/v3/users` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:04.099265 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb9afe-3153-45c8-9c58-f9bb58cb9d1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:04.100344 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb9afe-3153-45c8-9c58-f9bb58cb9d1d None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:04.130101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 237/473] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 22:48:03 2022] POST /identity/v3/users => generated 248 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:48:04.188498 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:04.213390 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693f82f-9d90-4ddd-afa2-5a89125860da None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:04.257692 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb2db4-d2d8-4630-a9e6-5ed36bcfe15a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4pNHIxJCRzOx6FPaTyaEgg, audit_chain_id=['4pNHIxJCRzOx6FPaTyaEgg']) at 0x7f8a0fdc2df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:04.258341 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb2db4-d2d8-4630-a9e6-5ed36bcfe15a None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:04.258633 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb2db4-d2d8-4630-a9e6-5ed36bcfe15a None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:04.258916 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb2db4-d2d8-4630-a9e6-5ed36bcfe15a None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:04.259639 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb2db4-d2d8-4630-a9e6-5ed36bcfe15a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:04.259951 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb2db4-d2d8-4630-a9e6-5ed36bcfe15a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:04.262032 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb2db4-d2d8-4630-a9e6-5ed36bcfe15a None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:04.276685 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 237/474] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:04.282989 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb9afe-3153-45c8-9c58-f9bb58cb9d1d None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:04.293820 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:04.404554 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb9afe-3153-45c8-9c58-f9bb58cb9d1d None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:04.440399 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6370898-1b59-439c-8420-b22f05cee862 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4pNHIxJCRzOx6FPaTyaEgg, audit_chain_id=['4pNHIxJCRzOx6FPaTyaEgg']) at 0x7f8a14128a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:04.441035 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6370898-1b59-439c-8420-b22f05cee862 None admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:04.441323 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6370898-1b59-439c-8420-b22f05cee862 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:04.441621 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6370898-1b59-439c-8420-b22f05cee862 None admin] PATH_INFO: `/v3/users` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:04.442314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6370898-1b59-439c-8420-b22f05cee862 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:04.443762 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6370898-1b59-439c-8420-b22f05cee862 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:04.468256 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 238/475] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 22:48:04 2022] POST /identity/v3/users => generated 249 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:48:05.799819 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7e1f4-f755-44b9-acad-5a5d7073a170 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:05.800330 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7e1f4-f755-44b9-acad-5a5d7073a170 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:05.800405 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7e1f4-f755-44b9-acad-5a5d7073a170 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:05.801984 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 238/476] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:05.807052 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4412b7-ad6e-4212-8182-99f096a6a69c None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:05.807436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4412b7-ad6e-4212-8182-99f096a6a69c None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:05.807617 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4412b7-ad6e-4212-8182-99f096a6a69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:05.826861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-3c4412b7-ad6e-4212-8182-99f096a6a69c None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:05.828053 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-3c4412b7-ad6e-4212-8182-99f096a6a69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:05.885348 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:05.897865 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 239/477] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:48:05.921975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7e1f4-f755-44b9-acad-5a5d7073a170 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:06.033540 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7e1f4-f755-44b9-acad-5a5d7073a170 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:06.070447 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984559e0-c099-4f6f-8c3a-707040b08b4a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6VDhen6TRxeM6AmeB59tUA, audit_chain_id=['6VDhen6TRxeM6AmeB59tUA']) at 0x7f8a0fdc2b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:06.071020 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984559e0-c099-4f6f-8c3a-707040b08b4a None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:06.071302 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984559e0-c099-4f6f-8c3a-707040b08b4a None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:06.071579 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984559e0-c099-4f6f-8c3a-707040b08b4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:06.079705 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:06.084019 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984559e0-c099-4f6f-8c3a-707040b08b4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:06.089256 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-984559e0-c099-4f6f-8c3a-707040b08b4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:06.089256 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:06.089256 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:06.089256 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:06.089256 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:06.089256 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:06.089256 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:06.089256 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:06.089256 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:06.089256 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:06.089256 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:06.089256 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:06.089256 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:06.089256 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:06.089256 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:06.089256 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:06.090323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:06.090323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:06.090323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:06.090323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:06.090323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:06.090323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:06.090323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:06.090323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:06.090323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:06.090323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:06.090323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:06.090323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:06.090323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:06.090323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:06.090323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:06.090323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:06.091117 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:06.091117 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:06.091117 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:06.091117 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:06.091117 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:06.091117 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:06.091117 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:06.091117 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:06.091117 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:06.091117 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:06.091117 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:06.091117 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:06.091117 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 239/478] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 22:48:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:06.096596 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4412b7-ad6e-4212-8182-99f096a6a69c None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:06.203348 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4412b7-ad6e-4212-8182-99f096a6a69c None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:06.242086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd666bb-35fe-49ca-9d5f-0332d3ea862c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6VDhen6TRxeM6AmeB59tUA, audit_chain_id=['6VDhen6TRxeM6AmeB59tUA']) at 0x7f8a0ff83a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:06.242713 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd666bb-35fe-49ca-9d5f-0332d3ea862c None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:06.242994 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd666bb-35fe-49ca-9d5f-0332d3ea862c None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:06.243270 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd666bb-35fe-49ca-9d5f-0332d3ea862c None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:06.243981 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd666bb-35fe-49ca-9d5f-0332d3ea862c None admin] RBAC: Adding query filter params (name=service) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:06.244285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd666bb-35fe-49ca-9d5f-0332d3ea862c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:06.246570 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd666bb-35fe-49ca-9d5f-0332d3ea862c None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:06.255351 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 240/479] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 22:48:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:06.260582 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984559e0-c099-4f6f-8c3a-707040b08b4a None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:06.353706 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50de622-baf8-4481-b3f1-7c9b792c5e1b None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:06.354003 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50de622-baf8-4481-b3f1-7c9b792c5e1b None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:06.354184 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50de622-baf8-4481-b3f1-7c9b792c5e1b None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:06.356768 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 241/480] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:48:06.362715 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca0317-e4f0-4e26-85b0-642e2bc30997 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:06.363002 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca0317-e4f0-4e26-85b0-642e2bc30997 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:06.363282 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca0317-e4f0-4e26-85b0-642e2bc30997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:06.374196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984559e0-c099-4f6f-8c3a-707040b08b4a None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:06.388694 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-80ca0317-e4f0-4e26-85b0-642e2bc30997 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:06.390881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-80ca0317-e4f0-4e26-85b0-642e2bc30997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:06.411880 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543425b-3b2e-477d-ab74-319c088bf88c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6VDhen6TRxeM6AmeB59tUA, audit_chain_id=['6VDhen6TRxeM6AmeB59tUA']) at 0x7f8a142ede20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:06.412534 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543425b-3b2e-477d-ab74-319c088bf88c None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:06.412821 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543425b-3b2e-477d-ab74-319c088bf88c None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:06.413102 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543425b-3b2e-477d-ab74-319c088bf88c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:06.424195 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543425b-3b2e-477d-ab74-319c088bf88c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:06.425848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543425b-3b2e-477d-ab74-319c088bf88c None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:06.445845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-e543425b-3b2e-477d-ab74-319c088bf88c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:06.445845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:06.445845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:06.445845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:06.445845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:06.445845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:06.445845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:06.445845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:06.445845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:06.445845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:06.445845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:06.445845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:06.445845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:06.445845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:06.445845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:06.446948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:06.446948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:06.446948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:06.446948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:06.446948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:06.446948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:06.446948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:06.446948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:06.446948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:06.446948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:06.446948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:06.446948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:06.446948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:06.446948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:06.446948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:06.446948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:06.446948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:06.448011 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:06.448011 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:06.448011 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:06.448011 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:06.448011 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 240/481] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:06.453638 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543425b-3b2e-477d-ab74-319c088bf88c None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:06.485442 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:06.485442 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 242/482] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:48:06.507760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca0317-e4f0-4e26-85b0-642e2bc30997 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:06.510791 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:06.579442 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543425b-3b2e-477d-ab74-319c088bf88c None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:06.618945 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9d75b-1aa2-4870-993b-a72d914be531 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6VDhen6TRxeM6AmeB59tUA, audit_chain_id=['6VDhen6TRxeM6AmeB59tUA']) at 0x7f8a0fdd50d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:06.619420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca0317-e4f0-4e26-85b0-642e2bc30997 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:06.619540 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9d75b-1aa2-4870-993b-a72d914be531 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:06.619756 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9d75b-1aa2-4870-993b-a72d914be531 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:06.620033 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9d75b-1aa2-4870-993b-a72d914be531 None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:06.620928 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9d75b-1aa2-4870-993b-a72d914be531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:06.621449 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9d75b-1aa2-4870-993b-a72d914be531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:06.622851 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9d75b-1aa2-4870-993b-a72d914be531 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:06.635737 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 241/483] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:06.640721 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4dee0-2793-40b4-b8da-919c9359bb01 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:06.641388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4dee0-2793-40b4-b8da-919c9359bb01 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:06.641718 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4dee0-2793-40b4-b8da-919c9359bb01 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:06.644064 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 242/484] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:06.645137 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4dee0-2793-40b4-b8da-919c9359bb01 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:06.664670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f75403-43ad-41c9-b2b7-e9905c7d9a6e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ckkPm7sCQvGBDMNkp43PHA, audit_chain_id=['ckkPm7sCQvGBDMNkp43PHA']) at 0x7f8a0fe08850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:06.665335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f75403-43ad-41c9-b2b7-e9905c7d9a6e None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:06.665641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f75403-43ad-41c9-b2b7-e9905c7d9a6e None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:06.665915 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f75403-43ad-41c9-b2b7-e9905c7d9a6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:06.678470 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f75403-43ad-41c9-b2b7-e9905c7d9a6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:06.684060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-25f75403-43ad-41c9-b2b7-e9905c7d9a6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:06.684060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:06.684060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:06.684060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:06.684060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:06.684060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:06.684060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:06.684060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:06.684060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:06.684060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:06.684060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:06.684060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:06.684060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:06.684060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:06.684060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:06.684060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:06.685317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:06.685317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:06.685317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:06.685317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:06.685317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:06.685317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:06.685317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:06.685317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:06.685317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:06.685317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:06.685317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:06.685317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:06.685317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:06.685317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:06.685317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:06.685317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:06.686128 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:06.686128 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:06.686128 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:06.686128 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:06.686128 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:06.686128 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:06.686128 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:06.686128 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:06.686128 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:06.686128 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:06.686128 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:06.686128 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:06.686128 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 243/485] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 22:48:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:06.687155 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4ddbb-1a0f-412a-b191-3542762ce49b None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:06.687155 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4ddbb-1a0f-412a-b191-3542762ce49b None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:06.687155 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4ddbb-1a0f-412a-b191-3542762ce49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:06.706210 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-bab4ddbb-1a0f-412a-b191-3542762ce49b None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:06.707409 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-bab4ddbb-1a0f-412a-b191-3542762ce49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:06.751411 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:06.779008 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4dee0-2793-40b4-b8da-919c9359bb01 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:06.789099 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 244/486] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:48:06.790245 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4ddbb-1a0f-412a-b191-3542762ce49b None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:06.796713 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:06.820434 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94bde7-b0d3-47a2-ae06-5dd90ebbe9c2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6VDhen6TRxeM6AmeB59tUA, audit_chain_id=['6VDhen6TRxeM6AmeB59tUA']) at 0x7f8a0fe32460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:06.821076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94bde7-b0d3-47a2-ae06-5dd90ebbe9c2 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:06.821359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94bde7-b0d3-47a2-ae06-5dd90ebbe9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:06.821664 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94bde7-b0d3-47a2-ae06-5dd90ebbe9c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:06.828924 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94bde7-b0d3-47a2-ae06-5dd90ebbe9c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:06.830392 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94bde7-b0d3-47a2-ae06-5dd90ebbe9c2 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:06.843753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-de94bde7-b0d3-47a2-ae06-5dd90ebbe9c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:48:06.843753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:06.843753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:06.843753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:06.843753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:06.843753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:06.843753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:06.843753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:06.843753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:06.843753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:06.843753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:06.843753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:06.843753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:06.843753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:06.843753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:06.843753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:06.844866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:06.844866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:06.844866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:06.844866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:06.844866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:06.844866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:06.844866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:06.844866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:06.844866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:06.844866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:06.844866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:06.844866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:06.844866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:06.844866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:06.844866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:06.844866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:06.844866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:06.844866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:06.845803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:06.845803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:06.845803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:06.845803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:06.845803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:06.845803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:06.845803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:06.845803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:06.845803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:48:06.845803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:06.845803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 243/487] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Jul 25 22:48:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:06.846473 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856ed76-7290-4b58-946b-cf5da9ea8352 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:06.846549 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856ed76-7290-4b58-946b-cf5da9ea8352 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:06.846776 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856ed76-7290-4b58-946b-cf5da9ea8352 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:06.852049 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 244/488] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:06.852049 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856ed76-7290-4b58-946b-cf5da9ea8352 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:06.906148 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4ddbb-1a0f-412a-b191-3542762ce49b None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:06.940386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3935a2b-bf7a-41de-8296-06fd20966be9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ckkPm7sCQvGBDMNkp43PHA, audit_chain_id=['ckkPm7sCQvGBDMNkp43PHA']) at 0x7f8a0fffca60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:06.941212 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935a2b-bf7a-41de-8296-06fd20966be9 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:06.941491 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935a2b-bf7a-41de-8296-06fd20966be9 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:06.941793 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935a2b-bf7a-41de-8296-06fd20966be9 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:06.942751 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3935a2b-bf7a-41de-8296-06fd20966be9 None admin] RBAC: Adding query filter params (name=service) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:06.942862 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3935a2b-bf7a-41de-8296-06fd20966be9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:06.944169 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3935a2b-bf7a-41de-8296-06fd20966be9 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:06.952317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 245/489] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 22:48:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:06.952567 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856ed76-7290-4b58-946b-cf5da9ea8352 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:06.953101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3935a2b-bf7a-41de-8296-06fd20966be9 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:06.987723 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:06.991069 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6a51cf-67c3-4a32-9ceb-70cb6a078df7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4-kHkzShTRy2tZpiWdCSSg, audit_chain_id=['4-kHkzShTRy2tZpiWdCSSg']) at 0x7f8a0fdc36d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:06.991718 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a51cf-67c3-4a32-9ceb-70cb6a078df7 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:06.992001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a51cf-67c3-4a32-9ceb-70cb6a078df7 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:06.992277 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a51cf-67c3-4a32-9ceb-70cb6a078df7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:07.003168 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6a51cf-67c3-4a32-9ceb-70cb6a078df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:07.008448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-2e6a51cf-67c3-4a32-9ceb-70cb6a078df7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:07.008448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:07.008448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:07.008448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:07.008448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:07.008448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:07.008448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:07.008448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:07.008448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:07.008448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:07.008448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:07.008448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:07.008448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:07.008448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:07.008448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:07.008448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:07.009347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:07.009347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:07.009347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:07.009347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:07.009347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:07.009347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:07.009347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:07.009347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:07.009347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:07.009347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:07.009347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:07.009347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:07.009347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:07.009347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:07.009347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:07.009347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:07.010214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:07.010214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:07.010214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:07.010214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:07.010214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:07.010214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:07.010214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:07.010214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:07.010214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:07.010214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:07.010214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:07.010214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:07.010214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 245/490] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 22:48:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:07.011183 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da475-1869-424e-9303-4dd6f6ea03b9 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:07.011183 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da475-1869-424e-9303-4dd6f6ea03b9 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:07.011820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63da475-1869-424e-9303-4dd6f6ea03b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:07.028579 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-f63da475-1869-424e-9303-4dd6f6ea03b9 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:07.029809 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-f63da475-1869-424e-9303-4dd6f6ea03b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:07.055483 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:07.060120 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3935a2b-bf7a-41de-8296-06fd20966be9 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:07.094057 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ddea4-d1cd-4154-96e5-c34678f8f7fd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6VDhen6TRxeM6AmeB59tUA, audit_chain_id=['6VDhen6TRxeM6AmeB59tUA']) at 0x7f8a0fd42910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:07.094670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ddea4-d1cd-4154-96e5-c34678f8f7fd None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:07.094951 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ddea4-d1cd-4154-96e5-c34678f8f7fd None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:07.095219 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ddea4-d1cd-4154-96e5-c34678f8f7fd None admin] PATH_INFO: `/v3/users` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:07.095996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ddea4-d1cd-4154-96e5-c34678f8f7fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:07.096302 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ddea4-d1cd-4154-96e5-c34678f8f7fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:07.097751 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ddea4-d1cd-4154-96e5-c34678f8f7fd None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:07.098132 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 246/491] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:48:07.098983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63da475-1869-424e-9303-4dd6f6ea03b9 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:07.145103 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 246/492] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Jul 25 22:48:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:07.145961 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ddea4-d1cd-4154-96e5-c34678f8f7fd None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:07.205290 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63da475-1869-424e-9303-4dd6f6ea03b9 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:07.238441 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:07.240346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56439fd-c558-4b29-a9b8-e22194dedcbc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ckkPm7sCQvGBDMNkp43PHA, audit_chain_id=['ckkPm7sCQvGBDMNkp43PHA']) at 0x7f8a0fe97c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:07.240993 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56439fd-c558-4b29-a9b8-e22194dedcbc None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:07.241271 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56439fd-c558-4b29-a9b8-e22194dedcbc None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:07.241543 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56439fd-c558-4b29-a9b8-e22194dedcbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:07.245503 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ddea4-d1cd-4154-96e5-c34678f8f7fd None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:07.252068 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56439fd-c558-4b29-a9b8-e22194dedcbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:07.253515 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56439fd-c558-4b29-a9b8-e22194dedcbc None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:07.268946 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-a56439fd-c558-4b29-a9b8-e22194dedcbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:07.268946 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:07.268946 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:07.268946 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:07.268946 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:07.268946 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:07.268946 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:07.268946 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:07.268946 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:07.268946 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:07.268946 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:07.268946 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:07.268946 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:07.268946 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:07.268946 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:07.270077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:07.270077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:07.270077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:07.270077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:07.270077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:07.270077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:07.270077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:07.270077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:07.270077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:07.270077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:07.270077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:07.270077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:07.270077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:07.270077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:07.270077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:07.270077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:07.270077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:07.270917 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:07.270917 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:07.270917 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:07.270917 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:07.270917 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 247/493] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:07.271649 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56439fd-c558-4b29-a9b8-e22194dedcbc None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:07.286462 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a441a-98c9-4c13-9c03-596570a4c169 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4-kHkzShTRy2tZpiWdCSSg, audit_chain_id=['4-kHkzShTRy2tZpiWdCSSg']) at 0x7f8a0fdf02b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:07.287079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a441a-98c9-4c13-9c03-596570a4c169 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:07.287360 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a441a-98c9-4c13-9c03-596570a4c169 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:07.287554 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:07.287666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a441a-98c9-4c13-9c03-596570a4c169 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:07.288319 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a441a-98c9-4c13-9c03-596570a4c169 None admin] RBAC: Adding query filter params (name=service) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:07.288779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a441a-98c9-4c13-9c03-596570a4c169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:07.290073 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a441a-98c9-4c13-9c03-596570a4c169 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:07.298196 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 247/494] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 22:48:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:07.298973 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a441a-98c9-4c13-9c03-596570a4c169 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:07.372308 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56439fd-c558-4b29-a9b8-e22194dedcbc None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:07.398031 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a441a-98c9-4c13-9c03-596570a4c169 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:07.406392 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9ba68-3f68-45c2-bd38-3821e98ce0b9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NPtd6MBRT0-HxACfa71KBQ, audit_chain_id=['NPtd6MBRT0-HxACfa71KBQ']) at 0x7f8a0fdda2e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:07.407032 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9ba68-3f68-45c2-bd38-3821e98ce0b9 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:07.407317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9ba68-3f68-45c2-bd38-3821e98ce0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:07.407598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9ba68-3f68-45c2-bd38-3821e98ce0b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:07.417796 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9ba68-3f68-45c2-bd38-3821e98ce0b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:07.423104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-0db9ba68-3f68-45c2-bd38-3821e98ce0b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:07.423104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:07.423104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:07.423104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:07.423104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:07.423104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:07.423104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:07.423104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:07.423104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:07.423104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:07.423104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:07.423104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:07.423104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:07.423104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:07.423104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:07.423104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:07.424087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:07.424087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:07.424087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:07.424087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:07.424087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:07.424087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:07.424087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:07.424087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:07.424087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:07.424087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:07.424087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:07.424087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:07.424087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:07.424087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:07.424087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:07.424087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:07.424884 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:07.424884 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:07.424884 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:07.424884 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:07.424884 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:07.424884 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:07.424884 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:07.424884 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:07.424884 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:07.424884 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:07.424884 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:07.424884 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:07.424884 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 248/495] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 22:48:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:07.425597 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9ba68-3f68-45c2-bd38-3821e98ce0b9 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:07.436503 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1fb0e-44e8-4831-80af-3d47487991b5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6VDhen6TRxeM6AmeB59tUA, audit_chain_id=['6VDhen6TRxeM6AmeB59tUA']) at 0x7f8a0fd41070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:07.437125 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1fb0e-44e8-4831-80af-3d47487991b5 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:07.437407 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1fb0e-44e8-4831-80af-3d47487991b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:07.437714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1fb0e-44e8-4831-80af-3d47487991b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:07.467535 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:07.502063 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:07.512285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1fb0e-44e8-4831-80af-3d47487991b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:07.513793 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1fb0e-44e8-4831-80af-3d47487991b5 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:07.528590 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9ba68-3f68-45c2-bd38-3821e98ce0b9 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:07.564170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6164c73-d9d8-4a37-96dc-8f30738c0e9e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ckkPm7sCQvGBDMNkp43PHA, audit_chain_id=['ckkPm7sCQvGBDMNkp43PHA']) at 0x7f8a0fdc3cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:07.564790 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6164c73-d9d8-4a37-96dc-8f30738c0e9e None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:07.565079 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6164c73-d9d8-4a37-96dc-8f30738c0e9e None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:07.565363 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6164c73-d9d8-4a37-96dc-8f30738c0e9e None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:07.566092 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6164c73-d9d8-4a37-96dc-8f30738c0e9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:07.566402 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6164c73-d9d8-4a37-96dc-8f30738c0e9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:07.567768 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6164c73-d9d8-4a37-96dc-8f30738c0e9e None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:07.579787 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 249/496] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:07.580408 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6164c73-d9d8-4a37-96dc-8f30738c0e9e None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:07.613954 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 248/497] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:48:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:48:07.614805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1fb0e-44e8-4831-80af-3d47487991b5 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:07.670043 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:07.679738 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6164c73-d9d8-4a37-96dc-8f30738c0e9e None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:07.714197 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1fb0e-44e8-4831-80af-3d47487991b5 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:07.714761 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc07701-0aab-47f9-82d0-f867215dbfc6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4-kHkzShTRy2tZpiWdCSSg, audit_chain_id=['4-kHkzShTRy2tZpiWdCSSg']) at 0x7f8a0fd82040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:07.715408 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc07701-0aab-47f9-82d0-f867215dbfc6 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:07.715734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc07701-0aab-47f9-82d0-f867215dbfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:07.716018 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc07701-0aab-47f9-82d0-f867215dbfc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:07.718005 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:07.727553 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc07701-0aab-47f9-82d0-f867215dbfc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:07.729012 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc07701-0aab-47f9-82d0-f867215dbfc6 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:07.744108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-fbc07701-0aab-47f9-82d0-f867215dbfc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:07.744108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:07.744108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:07.744108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:07.744108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:07.744108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:07.744108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:07.744108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:07.744108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:07.744108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:07.744108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:07.744108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:07.744108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:07.744108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:07.744108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:07.745056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:07.745056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:07.745056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:07.745056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:07.745056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:07.745056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:07.745056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:07.745056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:07.745056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:07.745056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:07.745056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:07.745056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:07.745056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:07.745056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:07.745056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:07.745056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:07.745056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:07.746718 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:07.746718 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:07.746718 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:07.746718 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:07.746718 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 250/498] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:07.747121 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc07701-0aab-47f9-82d0-f867215dbfc6 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:07.753607 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f2b15-de4f-4b5a-a300-5e5f7a2e4f33 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NPtd6MBRT0-HxACfa71KBQ, audit_chain_id=['NPtd6MBRT0-HxACfa71KBQ']) at 0x7f8a14115f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:07.754337 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f2b15-de4f-4b5a-a300-5e5f7a2e4f33 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:07.754628 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f2b15-de4f-4b5a-a300-5e5f7a2e4f33 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:07.754906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f2b15-de4f-4b5a-a300-5e5f7a2e4f33 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:07.755622 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f2b15-de4f-4b5a-a300-5e5f7a2e4f33 None admin] RBAC: Adding query filter params (name=service) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:07.755930 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f2b15-de4f-4b5a-a300-5e5f7a2e4f33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:07.757334 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f2b15-de4f-4b5a-a300-5e5f7a2e4f33 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:07.766227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 249/499] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 22:48:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:07.767024 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f2b15-de4f-4b5a-a300-5e5f7a2e4f33 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:07.853995 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc07701-0aab-47f9-82d0-f867215dbfc6 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:07.866547 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f2b15-de4f-4b5a-a300-5e5f7a2e4f33 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:07.883091 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:07.887645 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158113a0-9fc0-4b5d-b911-679e0136ba83 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ckkPm7sCQvGBDMNkp43PHA, audit_chain_id=['ckkPm7sCQvGBDMNkp43PHA']) at 0x7f8a0fdd9bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:07.888294 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158113a0-9fc0-4b5d-b911-679e0136ba83 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:07.888584 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158113a0-9fc0-4b5d-b911-679e0136ba83 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:07.888861 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158113a0-9fc0-4b5d-b911-679e0136ba83 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:07.896660 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158113a0-9fc0-4b5d-b911-679e0136ba83 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:07.898236 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158113a0-9fc0-4b5d-b911-679e0136ba83 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:07.900657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f597ff-d4e6-4f24-b8ea-c8187dfe376d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6VDhen6TRxeM6AmeB59tUA, audit_chain_id=['6VDhen6TRxeM6AmeB59tUA']) at 0x7f8a140e85b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:07.901292 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f597ff-d4e6-4f24-b8ea-c8187dfe376d None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:07.902641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f597ff-d4e6-4f24-b8ea-c8187dfe376d None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:07.902929 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f597ff-d4e6-4f24-b8ea-c8187dfe376d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:07.910101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-158113a0-9fc0-4b5d-b911-679e0136ba83 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:48:07.910101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:07.910101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:07.910101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:07.910101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:07.910101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:07.910101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:07.910101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:07.910101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:07.910101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:07.910101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:07.910101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:07.910101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:07.910101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:07.910101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:07.910101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:07.910986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:07.910986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:07.910986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:07.910986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:07.910986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:07.910986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:07.910986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:07.910986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:07.910986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:07.910986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:07.910986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:07.910986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:07.910986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:07.910986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:07.910986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:07.910986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:07.910986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:07.910986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:07.911859 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:07.911859 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:07.911859 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:07.911859 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:07.911859 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:07.911859 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:07.911859 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:07.911859 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:07.911859 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:48:07.911859 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:07.911859 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 251/500] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:48:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:07.912424 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158113a0-9fc0-4b5d-b911-679e0136ba83 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:07.915149 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f597ff-d4e6-4f24-b8ea-c8187dfe376d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:07.916748 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f597ff-d4e6-4f24-b8ea-c8187dfe376d None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:07.931739 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-02f597ff-d4e6-4f24-b8ea-c8187dfe376d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:07.931739 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:07.931739 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:07.931739 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:07.931739 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:07.931739 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:07.931739 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:07.931739 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:07.931739 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:07.931739 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:07.931739 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:07.931739 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:07.931739 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:07.931739 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:07.931739 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:07.932818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:07.932818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:07.932818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:07.932818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:07.932818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:07.932818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:07.932818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:07.932818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:07.932818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:07.932818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:07.932818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:07.932818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:07.932818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:07.932818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:07.932818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:07.932818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:07.932818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:07.938910 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:07.938910 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:07.938910 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:07.938910 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:07.938910 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 250/501] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:07.938910 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f597ff-d4e6-4f24-b8ea-c8187dfe376d None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:07.964712 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:08.019980 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158113a0-9fc0-4b5d-b911-679e0136ba83 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:08.037453 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f597ff-d4e6-4f24-b8ea-c8187dfe376d None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:08.053939 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49927745-e13d-41c3-aaca-165d70b5c445 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4-kHkzShTRy2tZpiWdCSSg, audit_chain_id=['4-kHkzShTRy2tZpiWdCSSg']) at 0x7f8a0fe97730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:08.054557 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49927745-e13d-41c3-aaca-165d70b5c445 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:08.054841 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49927745-e13d-41c3-aaca-165d70b5c445 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:08.055128 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49927745-e13d-41c3-aaca-165d70b5c445 None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:08.055815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49927745-e13d-41c3-aaca-165d70b5c445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:08.056121 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49927745-e13d-41c3-aaca-165d70b5c445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:08.057484 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49927745-e13d-41c3-aaca-165d70b5c445 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:08.069648 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 252/502] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:08.070443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49927745-e13d-41c3-aaca-165d70b5c445 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:08.076362 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf2eb2-2804-46f0-a854-f50cd3c53cce None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NPtd6MBRT0-HxACfa71KBQ, audit_chain_id=['NPtd6MBRT0-HxACfa71KBQ']) at 0x7f8a0fd66f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:08.077006 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf2eb2-2804-46f0-a854-f50cd3c53cce None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:08.077284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf2eb2-2804-46f0-a854-f50cd3c53cce None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:08.077557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf2eb2-2804-46f0-a854-f50cd3c53cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:08.095474 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf2eb2-2804-46f0-a854-f50cd3c53cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:08.096949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf2eb2-2804-46f0-a854-f50cd3c53cce None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:08.111418 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-57cf2eb2-2804-46f0-a854-f50cd3c53cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:08.111418 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:08.111418 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:08.111418 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:08.111418 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:08.111418 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:08.111418 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:08.111418 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:08.111418 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:08.111418 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:08.111418 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:08.111418 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:08.111418 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:08.111418 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:08.111418 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:08.112274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:08.112274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:08.112274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:08.112274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:08.112274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:08.112274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:08.112274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:08.112274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:08.112274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:08.112274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:08.112274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:08.112274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:08.112274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:08.112274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:08.112274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:08.112274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:08.112274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:08.113143 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:08.113143 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:08.113143 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:08.113143 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:08.113143 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 251/503] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:08.113411 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf2eb2-2804-46f0-a854-f50cd3c53cce None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:08.141164 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:08.177474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49927745-e13d-41c3-aaca-165d70b5c445 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:08.185084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:08.212092 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ea0b7-654a-41e7-9de9-c25941243bcc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ckkPm7sCQvGBDMNkp43PHA, audit_chain_id=['ckkPm7sCQvGBDMNkp43PHA']) at 0x7f8a0fdd0040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:08.212799 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ea0b7-654a-41e7-9de9-c25941243bcc None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:08.213157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ea0b7-654a-41e7-9de9-c25941243bcc None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:08.213505 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ea0b7-654a-41e7-9de9-c25941243bcc None admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:08.214954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ea0b7-654a-41e7-9de9-c25941243bcc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:08.215337 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ea0b7-654a-41e7-9de9-c25941243bcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:08.216837 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ea0b7-654a-41e7-9de9-c25941243bcc None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:08.218050 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf2eb2-2804-46f0-a854-f50cd3c53cce None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:08.251622 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d9506-7267-43c8-a9a9-ba3c3b8bcc63 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6VDhen6TRxeM6AmeB59tUA, audit_chain_id=['6VDhen6TRxeM6AmeB59tUA']) at 0x7f8a140ba1f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:08.252244 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d9506-7267-43c8-a9a9-ba3c3b8bcc63 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:08.252527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d9506-7267-43c8-a9a9-ba3c3b8bcc63 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:08.252650 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 253/504] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Jul 25 22:48:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:08.252803 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d9506-7267-43c8-a9a9-ba3c3b8bcc63 None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:08.253484 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ea0b7-654a-41e7-9de9-c25941243bcc None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:08.253562 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d9506-7267-43c8-a9a9-ba3c3b8bcc63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:08.253820 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d9506-7267-43c8-a9a9-ba3c3b8bcc63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:08.255195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d9506-7267-43c8-a9a9-ba3c3b8bcc63 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:08.267964 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 252/505] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:08.268886 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d9506-7267-43c8-a9a9-ba3c3b8bcc63 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:08.351388 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:08.353931 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ea0b7-654a-41e7-9de9-c25941243bcc None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:08.370301 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d9506-7267-43c8-a9a9-ba3c3b8bcc63 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:08.389692 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e9715-92f3-439b-a47f-d29ed4e112b0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4-kHkzShTRy2tZpiWdCSSg, audit_chain_id=['4-kHkzShTRy2tZpiWdCSSg']) at 0x7f8a0fde1f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:08.390339 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e9715-92f3-439b-a47f-d29ed4e112b0 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:08.390892 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e9715-92f3-439b-a47f-d29ed4e112b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:08.391169 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e9715-92f3-439b-a47f-d29ed4e112b0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:08.400074 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e9715-92f3-439b-a47f-d29ed4e112b0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:08.400074 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e9715-92f3-439b-a47f-d29ed4e112b0 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:08.409068 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba81941-8c77-4948-a95f-a7fb8b97113d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NPtd6MBRT0-HxACfa71KBQ, audit_chain_id=['NPtd6MBRT0-HxACfa71KBQ']) at 0x7f8a0fd88c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:08.409068 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba81941-8c77-4948-a95f-a7fb8b97113d None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:08.409068 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba81941-8c77-4948-a95f-a7fb8b97113d None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:08.409068 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba81941-8c77-4948-a95f-a7fb8b97113d None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:08.411268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba81941-8c77-4948-a95f-a7fb8b97113d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:08.411268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba81941-8c77-4948-a95f-a7fb8b97113d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:08.411268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba81941-8c77-4948-a95f-a7fb8b97113d None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:08.411982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-fa5e9715-92f3-439b-a47f-d29ed4e112b0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:48:08.411982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:08.411982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:08.411982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:08.411982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:08.411982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:08.411982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:08.411982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:08.411982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:08.411982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:08.411982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:08.411982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:08.411982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:08.411982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:08.411982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:08.411982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:08.413001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:08.413001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:08.413001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:08.413001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:08.413001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:08.413001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:08.413001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:08.413001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:08.413001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:08.413001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:08.413001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:08.413001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:08.413001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:08.413001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:08.413001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:08.413001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:08.413001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:08.413001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:08.413975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:08.413975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:08.413975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:08.413975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:08.413975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:08.413975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:08.413975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:08.413975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:08.413975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:48:08.413975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:08.413975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 254/506] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:48:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:08.414847 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e9715-92f3-439b-a47f-d29ed4e112b0 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:08.425070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 253/507] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:08.425924 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba81941-8c77-4948-a95f-a7fb8b97113d None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:08.442279 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:08.519333 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e9715-92f3-439b-a47f-d29ed4e112b0 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:08.528766 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba81941-8c77-4948-a95f-a7fb8b97113d None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:08.552788 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee86139-4fad-4415-bf5d-d181bd26337f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ckkPm7sCQvGBDMNkp43PHA, audit_chain_id=['ckkPm7sCQvGBDMNkp43PHA']) at 0x7f8a0fe3b880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:08.553404 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee86139-4fad-4415-bf5d-d181bd26337f None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:08.553723 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee86139-4fad-4415-bf5d-d181bd26337f None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:08.554009 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee86139-4fad-4415-bf5d-d181bd26337f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:08.561474 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143ae20-2903-4372-b48c-04c88e89c854 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6VDhen6TRxeM6AmeB59tUA, audit_chain_id=['6VDhen6TRxeM6AmeB59tUA']) at 0x7f8a155141f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:08.562146 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143ae20-2903-4372-b48c-04c88e89c854 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:08.562439 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143ae20-2903-4372-b48c-04c88e89c854 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:08.562714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143ae20-2903-4372-b48c-04c88e89c854 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:08.570406 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143ae20-2903-4372-b48c-04c88e89c854 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:08.571929 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143ae20-2903-4372-b48c-04c88e89c854 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:08.584386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-b143ae20-2903-4372-b48c-04c88e89c854 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:08.584386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:08.584386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:08.584386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:08.584386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:08.584386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:08.584386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:08.584386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:08.584386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:08.584386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:08.584386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:08.584386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:08.584386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:08.584386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:08.584386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:08.585281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:08.585281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:08.585281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:08.585281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:08.585281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:08.585281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:08.585281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:08.585281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:08.585281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:08.585281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:08.585281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:08.585281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:08.585281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:08.585281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:08.585281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:08.585281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:08.585281 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:08.586163 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:08.586163 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:08.586163 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:08.586163 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:08.586163 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:08.586163 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:08.586163 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:08.586163 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:08.586163 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 254/508] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:08.586651 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143ae20-2903-4372-b48c-04c88e89c854 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:08.588896 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:08.627496 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee86139-4fad-4415-bf5d-d181bd26337f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:08.628885 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee86139-4fad-4415-bf5d-d181bd26337f None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:08.654545 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:08.689076 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143ae20-2903-4372-b48c-04c88e89c854 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:08.725072 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387eb5e-8007-465b-8094-1083450fb3bf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4-kHkzShTRy2tZpiWdCSSg, audit_chain_id=['4-kHkzShTRy2tZpiWdCSSg']) at 0x7f8a0fd524f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:08.725718 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387eb5e-8007-465b-8094-1083450fb3bf None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:08.726000 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387eb5e-8007-465b-8094-1083450fb3bf None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:08.726273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387eb5e-8007-465b-8094-1083450fb3bf None admin] PATH_INFO: `/v3/users` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:08.727060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387eb5e-8007-465b-8094-1083450fb3bf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:08.727363 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387eb5e-8007-465b-8094-1083450fb3bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:08.728825 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387eb5e-8007-465b-8094-1083450fb3bf None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:08.731635 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 255/509] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:48:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:48:08.732508 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee86139-4fad-4415-bf5d-d181bd26337f None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:08.748019 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 255/510] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Jul 25 22:48:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:08.748848 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387eb5e-8007-465b-8094-1083450fb3bf None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:08.815050 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:08.842860 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee86139-4fad-4415-bf5d-d181bd26337f None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:08.857254 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387eb5e-8007-465b-8094-1083450fb3bf None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:08.866205 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:08.877563 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e4718-4f0a-4f98-865f-4cd0e68f51ab None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NPtd6MBRT0-HxACfa71KBQ, audit_chain_id=['NPtd6MBRT0-HxACfa71KBQ']) at 0x7f8a0fddac10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:08.878182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e4718-4f0a-4f98-865f-4cd0e68f51ab None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:08.878467 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e4718-4f0a-4f98-865f-4cd0e68f51ab None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:08.878749 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e4718-4f0a-4f98-865f-4cd0e68f51ab None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:08.885801 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e4718-4f0a-4f98-865f-4cd0e68f51ab None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:08.887243 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e4718-4f0a-4f98-865f-4cd0e68f51ab None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:08.891568 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d095e7-8470-4c40-a475-a9e9a1de8cf6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6VDhen6TRxeM6AmeB59tUA, audit_chain_id=['6VDhen6TRxeM6AmeB59tUA']) at 0x7f8a140d1640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:08.892187 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d095e7-8470-4c40-a475-a9e9a1de8cf6 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:08.892467 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d095e7-8470-4c40-a475-a9e9a1de8cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:08.892743 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d095e7-8470-4c40-a475-a9e9a1de8cf6 None admin] PATH_INFO: `/v3/projects` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:08.893480 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d095e7-8470-4c40-a475-a9e9a1de8cf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:08.893814 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d095e7-8470-4c40-a475-a9e9a1de8cf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:08.895243 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d095e7-8470-4c40-a475-a9e9a1de8cf6 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:08.899113 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-7b0e4718-4f0a-4f98-865f-4cd0e68f51ab None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:48:08.899113 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:08.899113 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:08.899113 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:08.899113 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:08.899113 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:08.899113 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:08.899113 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:08.899113 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:08.899113 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:08.899113 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:08.899113 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:08.899113 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:08.899113 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:08.899113 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:08.899113 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:08.900176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:08.900176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:08.900176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:08.900176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:08.900176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:08.900176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:08.900176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:08.900176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:08.900176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:08.900176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:08.900176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:08.900176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:08.900176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:08.900176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:08.900176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:08.900176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:08.900176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:08.900176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:08.901091 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:08.901091 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:08.901091 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:08.901091 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:08.901091 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:08.901091 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:08.901091 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:08.901091 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:08.901091 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:48:08.901091 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:08.901091 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 256/511] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 22:48:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:08.902219 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e4718-4f0a-4f98-865f-4cd0e68f51ab None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:08.913599 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 256/512] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:08.914436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d095e7-8470-4c40-a475-a9e9a1de8cf6 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:09.006085 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e4718-4f0a-4f98-865f-4cd0e68f51ab None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:09.014160 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d095e7-8470-4c40-a475-a9e9a1de8cf6 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:09.035257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:09.040433 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8102b84-1fee-4ae6-b1ff-45a4627c207e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ckkPm7sCQvGBDMNkp43PHA, audit_chain_id=['ckkPm7sCQvGBDMNkp43PHA']) at 0x7f8a0fd64520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:09.041077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8102b84-1fee-4ae6-b1ff-45a4627c207e None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:09.041363 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8102b84-1fee-4ae6-b1ff-45a4627c207e None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:09.041676 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8102b84-1fee-4ae6-b1ff-45a4627c207e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:09.050096 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66d0a8-5cad-4319-89ad-6d00a0673680 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4-kHkzShTRy2tZpiWdCSSg, audit_chain_id=['4-kHkzShTRy2tZpiWdCSSg']) at 0x7f8a0fdcfa00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:09.050720 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66d0a8-5cad-4319-89ad-6d00a0673680 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:09.051008 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66d0a8-5cad-4319-89ad-6d00a0673680 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:09.051287 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66d0a8-5cad-4319-89ad-6d00a0673680 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:09.052891 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8102b84-1fee-4ae6-b1ff-45a4627c207e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:09.054389 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8102b84-1fee-4ae6-b1ff-45a4627c207e None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:09.068856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-c8102b84-1fee-4ae6-b1ff-45a4627c207e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:09.068856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:09.068856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:09.068856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:09.068856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:09.068856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:09.068856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:09.068856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:09.068856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:09.068856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:09.068856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:09.068856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:09.068856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:09.068856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:09.068856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:09.069842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:09.069842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:09.069842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:09.069842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:09.069842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:09.069842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:09.069842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:09.069842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:09.069842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:09.069842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:09.069842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:09.069842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:09.069842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:09.069842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:09.069842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:09.069842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:09.069842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:09.070948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:09.070948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:09.070948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:09.070948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:09.070948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 257/513] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:09.071224 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8102b84-1fee-4ae6-b1ff-45a4627c207e None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:09.107975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:09.125436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66d0a8-5cad-4319-89ad-6d00a0673680 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:09.126962 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66d0a8-5cad-4319-89ad-6d00a0673680 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:09.174392 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8102b84-1fee-4ae6-b1ff-45a4627c207e None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:09.209415 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697cc0b-5ada-4bcb-8ca6-e346a983d753 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NPtd6MBRT0-HxACfa71KBQ, audit_chain_id=['NPtd6MBRT0-HxACfa71KBQ']) at 0x7f8a0fdc3310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:09.210176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697cc0b-5ada-4bcb-8ca6-e346a983d753 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:09.210533 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697cc0b-5ada-4bcb-8ca6-e346a983d753 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:09.210825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1697cc0b-5ada-4bcb-8ca6-e346a983d753 None admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:09.211600 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697cc0b-5ada-4bcb-8ca6-e346a983d753 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:09.211910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697cc0b-5ada-4bcb-8ca6-e346a983d753 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:09.213352 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1697cc0b-5ada-4bcb-8ca6-e346a983d753 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:09.228341 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 257/514] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:48:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:48:09.229192 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66d0a8-5cad-4319-89ad-6d00a0673680 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:09.231844 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 258/515] 10.222.0.47 () {56 vars in 1139 bytes} [Mon Jul 25 22:48:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:09.232677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697cc0b-5ada-4bcb-8ca6-e346a983d753 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:09.253637 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:09.328512 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:09.335193 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66d0a8-5cad-4319-89ad-6d00a0673680 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:09.335665 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1697cc0b-5ada-4bcb-8ca6-e346a983d753 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:09.369426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bd97f-b831-47b6-aa6f-da68b462a965 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ckkPm7sCQvGBDMNkp43PHA, audit_chain_id=['ckkPm7sCQvGBDMNkp43PHA']) at 0x7f8a0fdd0820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:09.369787 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2ddf0-921f-4a7a-a680-897cd43b6960 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6VDhen6TRxeM6AmeB59tUA, audit_chain_id=['6VDhen6TRxeM6AmeB59tUA']) at 0x7f8a141109d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:09.370691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bd97f-b831-47b6-aa6f-da68b462a965 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:09.370976 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2ddf0-921f-4a7a-a680-897cd43b6960 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:09.371163 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bd97f-b831-47b6-aa6f-da68b462a965 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:09.371269 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1bd97f-b831-47b6-aa6f-da68b462a965 None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:09.371353 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2ddf0-921f-4a7a-a680-897cd43b6960 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:09.371519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2ddf0-921f-4a7a-a680-897cd43b6960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:09.371916 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1bd97f-b831-47b6-aa6f-da68b462a965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:09.372220 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1bd97f-b831-47b6-aa6f-da68b462a965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:09.372316 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2ddf0-921f-4a7a-a680-897cd43b6960 None admin] RBAC: Adding query filter params (role.id=b50669f613ba46d78e9cb6c7e420b140, scope.project.id=2d1b44363d694c60867ec29af4f9d01e, user.id=a2528d7506a5481f8fa6bb5012b4a9dd) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:09.372600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2ddf0-921f-4a7a-a680-897cd43b6960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:09.373601 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1bd97f-b831-47b6-aa6f-da68b462a965 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:09.374073 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2ddf0-921f-4a7a-a680-897cd43b6960 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:09.379521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 258/516] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:48:09 2022] GET /identity/v3/role_assignments?user.id=a2528d7506a5481f8fa6bb5012b4a9dd&scope.project.id=2d1b44363d694c60867ec29af4f9d01e&role.id=b50669f613ba46d78e9cb6c7e420b140 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:09.380546 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2ddf0-921f-4a7a-a680-897cd43b6960 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:09.386578 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 259/517] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:09.387617 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bd97f-b831-47b6-aa6f-da68b462a965 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:09.491901 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:09.509268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1bd97f-b831-47b6-aa6f-da68b462a965 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:09.509720 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2ddf0-921f-4a7a-a680-897cd43b6960 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:09.548258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb565a7-f1be-4a35-a7df-80f38e16c222 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NPtd6MBRT0-HxACfa71KBQ, audit_chain_id=['NPtd6MBRT0-HxACfa71KBQ']) at 0x7f8a0fdcd850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:09.548892 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb565a7-f1be-4a35-a7df-80f38e16c222 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:09.549178 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb565a7-f1be-4a35-a7df-80f38e16c222 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:09.549451 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb565a7-f1be-4a35-a7df-80f38e16c222 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:09.550606 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbf22f-1990-461c-8b4c-1b9b8098f4b5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4-kHkzShTRy2tZpiWdCSSg, audit_chain_id=['4-kHkzShTRy2tZpiWdCSSg']) at 0x7f8a0fdf0c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:09.551001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbf22f-1990-461c-8b4c-1b9b8098f4b5 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:09.551286 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbf22f-1990-461c-8b4c-1b9b8098f4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:09.551564 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffbf22f-1990-461c-8b4c-1b9b8098f4b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:09.567947 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbf22f-1990-461c-8b4c-1b9b8098f4b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:09.569438 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffbf22f-1990-461c-8b4c-1b9b8098f4b5 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:09.582186 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:09.585223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-3ffbf22f-1990-461c-8b4c-1b9b8098f4b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:09.585223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:09.585223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:09.585223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:09.585223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:09.585223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:09.585223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:09.585223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:09.585223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:09.585223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:09.585223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:09.585223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:09.585223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:09.585223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:09.585223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:09.586104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:09.586104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:09.586104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:09.586104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:09.586104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:09.586104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:09.586104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:09.586104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:09.586104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:09.586104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:09.586104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:09.586104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:09.586104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:09.586104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:09.586104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:09.586104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:09.586104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:09.586923 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:09.586923 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:09.586923 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:09.586923 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:09.586923 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 259/518] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:09.587188 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbf22f-1990-461c-8b4c-1b9b8098f4b5 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:09.633851 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb565a7-f1be-4a35-a7df-80f38e16c222 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:09.635313 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb565a7-f1be-4a35-a7df-80f38e16c222 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:09.697118 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffbf22f-1990-461c-8b4c-1b9b8098f4b5 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:09.734022 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b55a9-9e4c-45d9-8e92-55944a25d94a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ckkPm7sCQvGBDMNkp43PHA, audit_chain_id=['ckkPm7sCQvGBDMNkp43PHA']) at 0x7f8a0fd42d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:09.734914 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b55a9-9e4c-45d9-8e92-55944a25d94a None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:09.735209 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b55a9-9e4c-45d9-8e92-55944a25d94a None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:09.735487 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b55a9-9e4c-45d9-8e92-55944a25d94a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:09.738812 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:09.743795 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b55a9-9e4c-45d9-8e92-55944a25d94a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:09.744799 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 260/519] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:48:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:48:09.746194 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b55a9-9e4c-45d9-8e92-55944a25d94a None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:09.747261 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb565a7-f1be-4a35-a7df-80f38e16c222 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:09.761805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-2e6b55a9-9e4c-45d9-8e92-55944a25d94a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:09.761805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:09.761805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:09.761805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:09.761805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:09.761805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:09.761805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:09.761805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:09.761805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:09.761805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:09.761805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:09.761805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:09.761805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:09.761805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:09.761805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:09.762691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:09.762691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:09.762691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:09.762691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:09.762691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:09.762691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:09.762691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:09.762691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:09.762691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:09.762691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:09.762691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:09.762691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:09.762691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:09.762691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:09.762691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:09.762691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:09.762691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:09.763531 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:09.763531 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:09.763531 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:09.763531 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:09.763531 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:09.763531 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:09.763531 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:09.763531 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:09.763531 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 260/520] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:09.763981 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b55a9-9e4c-45d9-8e92-55944a25d94a None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:09.811538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:09.863606 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb565a7-f1be-4a35-a7df-80f38e16c222 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:09.869403 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b55a9-9e4c-45d9-8e92-55944a25d94a None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:09.900326 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41808d-f196-499d-9352-49d1533c8d38 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4-kHkzShTRy2tZpiWdCSSg, audit_chain_id=['4-kHkzShTRy2tZpiWdCSSg']) at 0x7f8a0fdcddf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:09.900950 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41808d-f196-499d-9352-49d1533c8d38 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:09.901258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41808d-f196-499d-9352-49d1533c8d38 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:09.901541 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41808d-f196-499d-9352-49d1533c8d38 None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:09.902266 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41808d-f196-499d-9352-49d1533c8d38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:09.902578 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41808d-f196-499d-9352-49d1533c8d38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:09.903954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41808d-f196-499d-9352-49d1533c8d38 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:09.906080 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13e784-a755-46f6-9a7a-362aa1723c11 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NPtd6MBRT0-HxACfa71KBQ, audit_chain_id=['NPtd6MBRT0-HxACfa71KBQ']) at 0x7f8a0fd52790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:09.906714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13e784-a755-46f6-9a7a-362aa1723c11 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:09.906997 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13e784-a755-46f6-9a7a-362aa1723c11 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:09.907271 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13e784-a755-46f6-9a7a-362aa1723c11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:09.920750 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 261/521] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:09.920750 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41808d-f196-499d-9352-49d1533c8d38 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:09.924335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13e784-a755-46f6-9a7a-362aa1723c11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:09.925855 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e13e784-a755-46f6-9a7a-362aa1723c11 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:09.943271 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-6e13e784-a755-46f6-9a7a-362aa1723c11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:09.943271 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:09.943271 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:09.943271 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:09.943271 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:09.943271 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:09.943271 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:09.943271 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:09.943271 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:09.943271 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:09.943271 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:09.943271 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:09.943271 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:09.943271 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:09.943271 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:09.944150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:09.944150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:09.944150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:09.944150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:09.944150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:09.944150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:09.944150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:09.944150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:09.944150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:09.944150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:09.944150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:09.944150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:09.944150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:09.944150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:09.944150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:09.944150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:09.944150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:09.944989 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:09.944989 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:09.944989 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:09.944989 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:09.945915 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 261/522] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:09.945915 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13e784-a755-46f6-9a7a-362aa1723c11 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:09.998115 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:10.037377 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41808d-f196-499d-9352-49d1533c8d38 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:10.052765 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:10.058737 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13e784-a755-46f6-9a7a-362aa1723c11 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:10.077432 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560382ac-6eee-409a-bc7f-4eae347ef66a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ckkPm7sCQvGBDMNkp43PHA, audit_chain_id=['ckkPm7sCQvGBDMNkp43PHA']) at 0x7f8a0fdc84f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:10.078092 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560382ac-6eee-409a-bc7f-4eae347ef66a None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:10.078378 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560382ac-6eee-409a-bc7f-4eae347ef66a None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:10.078654 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560382ac-6eee-409a-bc7f-4eae347ef66a None admin] PATH_INFO: `/v3/projects` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:10.079411 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560382ac-6eee-409a-bc7f-4eae347ef66a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:10.079728 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560382ac-6eee-409a-bc7f-4eae347ef66a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:10.081259 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560382ac-6eee-409a-bc7f-4eae347ef66a None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:10.094606 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb682f7b-f778-4517-a38a-c37b7646ccb6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4-kHkzShTRy2tZpiWdCSSg, audit_chain_id=['4-kHkzShTRy2tZpiWdCSSg']) at 0x7f8a0fe66310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:10.095525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb682f7b-f778-4517-a38a-c37b7646ccb6 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:10.095989 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb682f7b-f778-4517-a38a-c37b7646ccb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:10.096445 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb682f7b-f778-4517-a38a-c37b7646ccb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:10.099901 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 262/523] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:10.100738 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560382ac-6eee-409a-bc7f-4eae347ef66a None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:10.104096 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb682f7b-f778-4517-a38a-c37b7646ccb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:10.106364 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb682f7b-f778-4517-a38a-c37b7646ccb6 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:10.118237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-cb682f7b-f778-4517-a38a-c37b7646ccb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:10.118237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:10.118237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:10.118237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:10.118237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:10.118237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:10.118237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:10.118237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:10.118237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:10.118237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:10.118237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:10.118237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:10.118237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:10.118237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:10.118237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:10.119297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:10.119297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:10.119297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:10.119297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:10.119297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:10.119297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:10.119297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:10.119297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:10.119297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:10.119297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:10.119297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:10.119297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:10.119297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:10.119297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:10.119297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:10.119297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:10.119297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:10.120603 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:10.120603 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:10.120603 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:10.120603 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:10.120603 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:10.120603 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:10.120603 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:10.120603 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:10.124129 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 262/524] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:10.124992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb682f7b-f778-4517-a38a-c37b7646ccb6 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:10.225335 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560382ac-6eee-409a-bc7f-4eae347ef66a None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:10.246038 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb682f7b-f778-4517-a38a-c37b7646ccb6 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:10.255956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:10.272106 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada509f6-3663-40b2-82a4-ba9cde4b0b9d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NPtd6MBRT0-HxACfa71KBQ, audit_chain_id=['NPtd6MBRT0-HxACfa71KBQ']) at 0x7f8a0fdff220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:10.272842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada509f6-3663-40b2-82a4-ba9cde4b0b9d None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:10.273129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada509f6-3663-40b2-82a4-ba9cde4b0b9d None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:10.273518 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada509f6-3663-40b2-82a4-ba9cde4b0b9d None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:10.274244 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada509f6-3663-40b2-82a4-ba9cde4b0b9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:10.274555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada509f6-3663-40b2-82a4-ba9cde4b0b9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:10.276040 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada509f6-3663-40b2-82a4-ba9cde4b0b9d None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:10.282100 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66f89a-5e4f-41b0-9d8d-7221b5ff9f8f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ckkPm7sCQvGBDMNkp43PHA, audit_chain_id=['ckkPm7sCQvGBDMNkp43PHA']) at 0x7f8a0fd427c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:10.282714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66f89a-5e4f-41b0-9d8d-7221b5ff9f8f None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:10.282994 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66f89a-5e4f-41b0-9d8d-7221b5ff9f8f None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:10.283267 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66f89a-5e4f-41b0-9d8d-7221b5ff9f8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:10.284043 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66f89a-5e4f-41b0-9d8d-7221b5ff9f8f None admin] RBAC: Adding query filter params (role.id=b50669f613ba46d78e9cb6c7e420b140, scope.project.id=2d1b44363d694c60867ec29af4f9d01e, user.id=bea7c9ce1d3c4fe983e5944e5f92ff91) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:10.284348 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66f89a-5e4f-41b0-9d8d-7221b5ff9f8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:10.285798 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66f89a-5e4f-41b0-9d8d-7221b5ff9f8f None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:10.298093 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 263/525] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:48:10 2022] GET /identity/v3/role_assignments?user.id=bea7c9ce1d3c4fe983e5944e5f92ff91&scope.project.id=2d1b44363d694c60867ec29af4f9d01e&role.id=b50669f613ba46d78e9cb6c7e420b140 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:10.298093 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66f89a-5e4f-41b0-9d8d-7221b5ff9f8f None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:10.298387 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 263/526] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:10.298387 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada509f6-3663-40b2-82a4-ba9cde4b0b9d None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:10.342996 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:10.431582 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada509f6-3663-40b2-82a4-ba9cde4b0b9d None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:10.443421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66f89a-5e4f-41b0-9d8d-7221b5ff9f8f None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:10.490576 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958c999-6c4a-4aa2-a347-092103b9c19e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NPtd6MBRT0-HxACfa71KBQ, audit_chain_id=['NPtd6MBRT0-HxACfa71KBQ']) at 0x7f8a0fe97160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:10.492783 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958c999-6c4a-4aa2-a347-092103b9c19e None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:10.493340 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958c999-6c4a-4aa2-a347-092103b9c19e None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:10.493854 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958c999-6c4a-4aa2-a347-092103b9c19e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:10.499072 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54020697-b185-4edc-9482-53740c4335c2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4-kHkzShTRy2tZpiWdCSSg, audit_chain_id=['4-kHkzShTRy2tZpiWdCSSg']) at 0x7f8a0fe46eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:10.499604 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54020697-b185-4edc-9482-53740c4335c2 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:10.499885 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54020697-b185-4edc-9482-53740c4335c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:10.500159 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54020697-b185-4edc-9482-53740c4335c2 None admin] PATH_INFO: `/v3/projects` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:10.500913 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54020697-b185-4edc-9482-53740c4335c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:10.501845 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54020697-b185-4edc-9482-53740c4335c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:10.503567 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54020697-b185-4edc-9482-53740c4335c2 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:10.504453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958c999-6c4a-4aa2-a347-092103b9c19e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:10.509240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958c999-6c4a-4aa2-a347-092103b9c19e None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:10.523873 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 264/527] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:10.528595 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-e958c999-6c4a-4aa2-a347-092103b9c19e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:10.528595 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:10.528595 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:10.528595 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:10.528595 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:10.528595 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:10.528595 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:10.528595 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:10.528595 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:10.528595 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:10.528595 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:10.528595 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:10.528595 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:10.528595 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:10.528595 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:10.529514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:10.529514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:10.529514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:10.529514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:10.529514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:10.529514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:10.529514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:10.529514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:10.529514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:10.529514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:10.529514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:10.529514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:10.529514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:10.529514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:10.529514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:10.529514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:10.529514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:10.530433 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:10.530433 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:10.530433 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:10.530433 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:10.530433 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:10.530433 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:10.530433 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:10.530433 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:10.530433 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 264/528] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:10.533865 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54020697-b185-4edc-9482-53740c4335c2 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:10.538642 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958c999-6c4a-4aa2-a347-092103b9c19e None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:10.575557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:10.666443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:10.671649 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54020697-b185-4edc-9482-53740c4335c2 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:10.676567 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958c999-6c4a-4aa2-a347-092103b9c19e None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:10.720977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d224482-f720-4c32-9b35-ac1a309151ae None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4-kHkzShTRy2tZpiWdCSSg, audit_chain_id=['4-kHkzShTRy2tZpiWdCSSg']) at 0x7f8a0fe0ce80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:10.721196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1684aa9-72ff-4c3a-9e9f-41a7105d3af1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NPtd6MBRT0-HxACfa71KBQ, audit_chain_id=['NPtd6MBRT0-HxACfa71KBQ']) at 0x7f8a0fdd91f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:10.721642 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1684aa9-72ff-4c3a-9e9f-41a7105d3af1 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:10.722064 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1684aa9-72ff-4c3a-9e9f-41a7105d3af1 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:10.722342 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1684aa9-72ff-4c3a-9e9f-41a7105d3af1 None admin] PATH_INFO: `/v3/projects` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:10.722940 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d224482-f720-4c32-9b35-ac1a309151ae None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:10.723091 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1684aa9-72ff-4c3a-9e9f-41a7105d3af1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:10.723404 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1684aa9-72ff-4c3a-9e9f-41a7105d3af1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:10.723657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d224482-f720-4c32-9b35-ac1a309151ae None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:10.724170 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d224482-f720-4c32-9b35-ac1a309151ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:10.724846 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1684aa9-72ff-4c3a-9e9f-41a7105d3af1 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:10.725429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d224482-f720-4c32-9b35-ac1a309151ae None admin] RBAC: Adding query filter params (role.id=b50669f613ba46d78e9cb6c7e420b140, scope.project.id=2d1b44363d694c60867ec29af4f9d01e, user.id=cc1a058881084fbdbf53096109e5381f) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:10.725915 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d224482-f720-4c32-9b35-ac1a309151ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:10.727704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d224482-f720-4c32-9b35-ac1a309151ae None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:10.736671 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 265/529] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:48:10 2022] GET /identity/v3/role_assignments?user.id=cc1a058881084fbdbf53096109e5381f&scope.project.id=2d1b44363d694c60867ec29af4f9d01e&role.id=b50669f613ba46d78e9cb6c7e420b140 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:10.745693 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 265/530] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:10.751382 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d224482-f720-4c32-9b35-ac1a309151ae None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:10.894920 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:10.903943 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d224482-f720-4c32-9b35-ac1a309151ae None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:10.952244 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e747a7-6a6f-4dc0-af6f-c284da115c8e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NPtd6MBRT0-HxACfa71KBQ, audit_chain_id=['NPtd6MBRT0-HxACfa71KBQ']) at 0x7f8a0fdc06a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:10.952880 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e747a7-6a6f-4dc0-af6f-c284da115c8e None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:10.953167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e747a7-6a6f-4dc0-af6f-c284da115c8e None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:10.953445 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e747a7-6a6f-4dc0-af6f-c284da115c8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:10.954285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e747a7-6a6f-4dc0-af6f-c284da115c8e None admin] RBAC: Adding query filter params (role.id=b50669f613ba46d78e9cb6c7e420b140, scope.project.id=2d1b44363d694c60867ec29af4f9d01e, user.id=f77ef50984084af9bcd220fc68deacf8) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:10.954600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e747a7-6a6f-4dc0-af6f-c284da115c8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:10.956050 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e747a7-6a6f-4dc0-af6f-c284da115c8e None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:10.963013 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 266/531] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:48:10 2022] GET /identity/v3/role_assignments?user.id=f77ef50984084af9bcd220fc68deacf8&scope.project.id=2d1b44363d694c60867ec29af4f9d01e&role.id=b50669f613ba46d78e9cb6c7e420b140 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:11.673139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b909ff-4fc7-4bfb-a7b0-d5181cb3f310 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:11.673719 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b909ff-4fc7-4bfb-a7b0-d5181cb3f310 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:11.673719 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b909ff-4fc7-4bfb-a7b0-d5181cb3f310 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:11.675306 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 266/532] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:11.680539 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09fa28-5348-4952-afc4-8160c35ac428 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:11.680922 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09fa28-5348-4952-afc4-8160c35ac428 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:11.681108 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09fa28-5348-4952-afc4-8160c35ac428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:11.699942 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-cc09fa28-5348-4952-afc4-8160c35ac428 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:11.701153 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-cc09fa28-5348-4952-afc4-8160c35ac428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:11.772870 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 267/533] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:48:11.797546 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b909ff-4fc7-4bfb-a7b0-d5181cb3f310 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:11.906514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b909ff-4fc7-4bfb-a7b0-d5181cb3f310 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:11.943371 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89dfa3-ede8-41ac-b4c6-deffbc1db0ab None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xb3RXjPqRtes9217cO6-Nw, audit_chain_id=['xb3RXjPqRtes9217cO6-Nw']) at 0x7f8a0fe3a6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:11.944108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89dfa3-ede8-41ac-b4c6-deffbc1db0ab None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:11.944400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89dfa3-ede8-41ac-b4c6-deffbc1db0ab None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:11.944679 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89dfa3-ede8-41ac-b4c6-deffbc1db0ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:11.957161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89dfa3-ede8-41ac-b4c6-deffbc1db0ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:11.962122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-9c89dfa3-ede8-41ac-b4c6-deffbc1db0ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:11.962122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:11.962122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:11.962122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:11.962122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:11.962122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:11.962122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:11.962122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:11.962122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:11.962122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:11.962122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:11.962122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:11.962122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:11.962122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:11.962122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:11.962122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:11.962986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:11.962986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:11.962986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:11.962986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:11.962986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:11.962986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:11.962986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:11.962986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:11.962986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:11.962986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:11.962986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:11.962986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:11.962986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:11.962986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:11.962986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:11.962986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:11.964372 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:11.964372 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:11.964372 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:11.964372 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:11.964372 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:11.964372 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:11.964372 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:11.964372 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:11.964372 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:11.964372 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:11.964372 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:11.964372 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:11.964372 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 267/534] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 22:48:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:11.969683 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09fa28-5348-4952-afc4-8160c35ac428 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:12.065368 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:12.076538 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09fa28-5348-4952-afc4-8160c35ac428 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:12.112062 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a72af-6449-48e7-b11a-9ded5b957d52 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xb3RXjPqRtes9217cO6-Nw, audit_chain_id=['xb3RXjPqRtes9217cO6-Nw']) at 0x7f8a0fe25280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:12.112688 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a72af-6449-48e7-b11a-9ded5b957d52 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:12.112970 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a72af-6449-48e7-b11a-9ded5b957d52 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:12.113243 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a72af-6449-48e7-b11a-9ded5b957d52 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:12.113988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a72af-6449-48e7-b11a-9ded5b957d52 None admin] RBAC: Adding query filter params (name=service) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:12.114293 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a72af-6449-48e7-b11a-9ded5b957d52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:12.115682 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a72af-6449-48e7-b11a-9ded5b957d52 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:12.124514 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 268/535] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 22:48:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:12.129766 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89dfa3-ede8-41ac-b4c6-deffbc1db0ab None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:12.148621 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:12.239668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89dfa3-ede8-41ac-b4c6-deffbc1db0ab None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:12.279003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b23f13-f847-4eef-b922-758adcc07e32 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xb3RXjPqRtes9217cO6-Nw, audit_chain_id=['xb3RXjPqRtes9217cO6-Nw']) at 0x7f8a0fd25040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:12.279948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b23f13-f847-4eef-b922-758adcc07e32 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:12.280442 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b23f13-f847-4eef-b922-758adcc07e32 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:12.280964 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b23f13-f847-4eef-b922-758adcc07e32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:12.292332 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b23f13-f847-4eef-b922-758adcc07e32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:12.294098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b23f13-f847-4eef-b922-758adcc07e32 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:12.309147 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-d6b23f13-f847-4eef-b922-758adcc07e32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:12.309147 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:12.309147 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:12.309147 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:12.309147 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:12.309147 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:12.309147 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:12.309147 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:12.309147 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:12.309147 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:12.309147 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:12.309147 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:12.309147 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:12.309147 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:12.309147 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:12.310077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:12.310077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:12.310077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:12.310077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:12.310077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:12.310077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:12.310077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:12.310077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:12.310077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:12.310077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:12.310077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:12.310077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:12.310077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:12.310077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:12.310077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:12.310077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:12.310077 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:12.310919 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:12.310919 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:12.310919 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:12.310919 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:12.312897 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 268/536] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:12.318708 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a72af-6449-48e7-b11a-9ded5b957d52 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:12.431836 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a72af-6449-48e7-b11a-9ded5b957d52 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:12.467725 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0429c84-ae3e-4351-b482-796199c0f598 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xb3RXjPqRtes9217cO6-Nw, audit_chain_id=['xb3RXjPqRtes9217cO6-Nw']) at 0x7f8a0fd52d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:12.468357 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0429c84-ae3e-4351-b482-796199c0f598 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:12.468642 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0429c84-ae3e-4351-b482-796199c0f598 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:12.468922 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0429c84-ae3e-4351-b482-796199c0f598 None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:12.469633 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0429c84-ae3e-4351-b482-796199c0f598 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:12.469947 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0429c84-ae3e-4351-b482-796199c0f598 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:12.471345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0429c84-ae3e-4351-b482-796199c0f598 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:12.484529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 269/537] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:12.490016 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b23f13-f847-4eef-b922-758adcc07e32 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:12.574143 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:12.608437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b23f13-f847-4eef-b922-758adcc07e32 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:12.647785 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04910c-9a48-48a6-818f-90a37032fe28 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xb3RXjPqRtes9217cO6-Nw, audit_chain_id=['xb3RXjPqRtes9217cO6-Nw']) at 0x7f8a0fd82d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:12.648437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04910c-9a48-48a6-818f-90a37032fe28 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:12.648725 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04910c-9a48-48a6-818f-90a37032fe28 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:12.649004 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04910c-9a48-48a6-818f-90a37032fe28 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:12.657075 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04910c-9a48-48a6-818f-90a37032fe28 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:12.658573 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04910c-9a48-48a6-818f-90a37032fe28 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:12.670173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-7e04910c-9a48-48a6-818f-90a37032fe28 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:48:12.670173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:12.670173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:12.670173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:12.670173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:12.670173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:12.670173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:12.670173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:12.670173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:12.670173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:12.670173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:12.670173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:12.670173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:12.670173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:12.670173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:12.670173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:12.671135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:12.671135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:12.671135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:12.671135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:12.671135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:12.671135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:12.671135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:12.671135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:12.671135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:12.671135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:12.671135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:12.671135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:12.671135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:12.671135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:12.671135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:12.671135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:12.671135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:12.671135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:12.672072 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:12.672072 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:12.672072 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:12.672072 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:12.672072 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:12.672072 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:12.672072 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:12.672072 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:12.672072 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:48:12.672072 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:12.672072 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 269/538] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Jul 25 22:48:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:12.679042 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0429c84-ae3e-4351-b482-796199c0f598 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:12.700689 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:12.776581 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb60195-a6a3-4a2e-b0aa-6234e1683885 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:12.777158 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb60195-a6a3-4a2e-b0aa-6234e1683885 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:12.777158 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb60195-a6a3-4a2e-b0aa-6234e1683885 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:12.779745 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 270/539] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:48:12.783847 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ccc6f-ccb4-41ca-83e1-aa12b08bcaeb None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:12.784146 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ccc6f-ccb4-41ca-83e1-aa12b08bcaeb None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:12.784437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ccc6f-ccb4-41ca-83e1-aa12b08bcaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:12.793530 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0429c84-ae3e-4351-b482-796199c0f598 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:12.803443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-732ccc6f-ccb4-41ca-83e1-aa12b08bcaeb None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:12.804655 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-732ccc6f-ccb4-41ca-83e1-aa12b08bcaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:12.834916 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259b7d9-8d43-4a9d-88d3-8c7f3d9ae64c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xb3RXjPqRtes9217cO6-Nw, audit_chain_id=['xb3RXjPqRtes9217cO6-Nw']) at 0x7f8a0fd45700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:12.835460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259b7d9-8d43-4a9d-88d3-8c7f3d9ae64c None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:12.835742 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259b7d9-8d43-4a9d-88d3-8c7f3d9ae64c None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:12.836016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259b7d9-8d43-4a9d-88d3-8c7f3d9ae64c None admin] PATH_INFO: `/v3/users` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:12.836809 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259b7d9-8d43-4a9d-88d3-8c7f3d9ae64c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:12.837122 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259b7d9-8d43-4a9d-88d3-8c7f3d9ae64c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:12.839166 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259b7d9-8d43-4a9d-88d3-8c7f3d9ae64c None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:12.859349 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 270/540] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Jul 25 22:48:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:12.864847 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259b7d9-8d43-4a9d-88d3-8c7f3d9ae64c None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:12.897688 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 271/541] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:48:12.913815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ccc6f-ccb4-41ca-83e1-aa12b08bcaeb None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:12.944547 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:12.972215 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:12.984744 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259b7d9-8d43-4a9d-88d3-8c7f3d9ae64c None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:13.023328 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ccc6f-ccb4-41ca-83e1-aa12b08bcaeb None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:13.025888 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc6abc-5dfb-4d0f-a863-cc98f183d8cc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xb3RXjPqRtes9217cO6-Nw, audit_chain_id=['xb3RXjPqRtes9217cO6-Nw']) at 0x7f8a0fdf02b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:13.026692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc6abc-5dfb-4d0f-a863-cc98f183d8cc None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.026976 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc6abc-5dfb-4d0f-a863-cc98f183d8cc None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.027257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc6abc-5dfb-4d0f-a863-cc98f183d8cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:13.038946 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc6abc-5dfb-4d0f-a863-cc98f183d8cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:13.040429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc6abc-5dfb-4d0f-a863-cc98f183d8cc None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:13.058216 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-93bc6abc-5dfb-4d0f-a863-cc98f183d8cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:13.058216 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:13.058216 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:13.058216 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:13.058216 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:13.058216 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:13.058216 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:13.058216 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:13.058216 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:13.058216 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:13.058216 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:13.058216 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:13.058216 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:13.058216 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:13.058216 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:13.059299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:13.059299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:13.059299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:13.059299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:13.059299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:13.059299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:13.059299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:13.059299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:13.059299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:13.059299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:13.059299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:13.059299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:13.059299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:13.059299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:13.059299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:13.059299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:13.059299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:13.060140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:13.060140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:13.060140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:13.060140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:13.062464 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 271/542] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:13.063030 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d701c3c-ffad-432e-a311-bb013ee58736 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ui2d6DW-RGCs_ZHiIKPK0A, audit_chain_id=['Ui2d6DW-RGCs_ZHiIKPK0A']) at 0x7f8a0fdc3f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:13.063805 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d701c3c-ffad-432e-a311-bb013ee58736 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.064158 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d701c3c-ffad-432e-a311-bb013ee58736 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.064504 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d701c3c-ffad-432e-a311-bb013ee58736 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:13.070820 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc6abc-5dfb-4d0f-a863-cc98f183d8cc None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:13.075665 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d701c3c-ffad-432e-a311-bb013ee58736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:13.080698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-4d701c3c-ffad-432e-a311-bb013ee58736 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:13.080698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:13.080698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:13.080698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:13.080698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:13.080698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:13.080698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:13.080698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:13.080698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:13.080698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:13.080698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:13.080698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:13.080698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:13.080698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:13.080698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:13.080698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:13.081604 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:13.081604 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:13.081604 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:13.081604 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:13.081604 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:13.081604 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:13.081604 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:13.081604 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:13.081604 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:13.081604 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:13.081604 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:13.081604 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:13.081604 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:13.081604 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:13.081604 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:13.081604 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:13.082415 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:13.082415 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:13.082415 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:13.082415 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:13.082415 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:13.082415 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:13.082415 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:13.082415 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:13.082415 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:13.082415 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:13.082415 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:13.082415 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:13.086955 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 272/543] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 22:48:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:13.088271 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d701c3c-ffad-432e-a311-bb013ee58736 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:13.186647 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc6abc-5dfb-4d0f-a863-cc98f183d8cc None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:13.195652 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d701c3c-ffad-432e-a311-bb013ee58736 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:13.212944 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:13.213451 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:13.226967 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813cc88-ebe9-4a02-9739-18dfc8ba9588 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xb3RXjPqRtes9217cO6-Nw, audit_chain_id=['xb3RXjPqRtes9217cO6-Nw']) at 0x7f8a0fd1c4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:13.227790 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813cc88-ebe9-4a02-9739-18dfc8ba9588 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.228151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813cc88-ebe9-4a02-9739-18dfc8ba9588 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.228503 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813cc88-ebe9-4a02-9739-18dfc8ba9588 None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:13.229912 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813cc88-ebe9-4a02-9739-18dfc8ba9588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:13.230381 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813cc88-ebe9-4a02-9739-18dfc8ba9588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:13.231944 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813cc88-ebe9-4a02-9739-18dfc8ba9588 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:13.235930 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a575819-02a6-4403-8bfb-0ee5682ca280 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ui2d6DW-RGCs_ZHiIKPK0A, audit_chain_id=['Ui2d6DW-RGCs_ZHiIKPK0A']) at 0x7f8a0fd5cfa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:13.236583 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a575819-02a6-4403-8bfb-0ee5682ca280 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.236866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a575819-02a6-4403-8bfb-0ee5682ca280 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.237143 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a575819-02a6-4403-8bfb-0ee5682ca280 None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:13.237912 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a575819-02a6-4403-8bfb-0ee5682ca280 None admin] RBAC: Adding query filter params (name=service) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:13.238225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a575819-02a6-4403-8bfb-0ee5682ca280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:13.239656 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a575819-02a6-4403-8bfb-0ee5682ca280 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:13.247108 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 272/544] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:13.248542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc68061-40fb-4413-8046-54e4f9a3111c None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.248908 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc68061-40fb-4413-8046-54e4f9a3111c None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.249258 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc68061-40fb-4413-8046-54e4f9a3111c None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:13.250947 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 273/545] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:13.258487 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc68061-40fb-4413-8046-54e4f9a3111c None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:13.258679 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 273/546] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 22:48:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:13.259563 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290df6f5-46ca-4f0a-8708-de939a227b9c None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.259563 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290df6f5-46ca-4f0a-8708-de939a227b9c None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.259856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290df6f5-46ca-4f0a-8708-de939a227b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:13.278966 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-290df6f5-46ca-4f0a-8708-de939a227b9c None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:13.280163 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-290df6f5-46ca-4f0a-8708-de939a227b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:13.353425 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 274/547] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:48:13.355260 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290df6f5-46ca-4f0a-8708-de939a227b9c None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:13.391334 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc68061-40fb-4413-8046-54e4f9a3111c None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:13.428600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d48c0-513a-4123-83fd-de1bbd00f6b0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xb3RXjPqRtes9217cO6-Nw, audit_chain_id=['xb3RXjPqRtes9217cO6-Nw']) at 0x7f8a1413d250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:13.429239 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d48c0-513a-4123-83fd-de1bbd00f6b0 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.429519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d48c0-513a-4123-83fd-de1bbd00f6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.429820 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d48c0-513a-4123-83fd-de1bbd00f6b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:13.436406 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d48c0-513a-4123-83fd-de1bbd00f6b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:13.437888 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d48c0-513a-4123-83fd-de1bbd00f6b0 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:13.449527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-ec4d48c0-513a-4123-83fd-de1bbd00f6b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:13.449527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:13.449527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:13.449527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:13.449527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:13.449527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:13.449527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:13.449527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:13.449527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:13.449527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:13.449527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:13.449527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:13.449527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:13.449527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:13.449527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:13.450454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:13.450454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:13.450454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:13.450454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:13.450454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:13.450454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:13.450454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:13.450454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:13.450454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:13.450454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:13.450454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:13.450454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:13.450454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:13.450454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:13.450454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:13.450454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:13.450454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:13.451291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:13.451291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:13.451291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:13.451291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:13.451291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:13.451291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:13.451291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:13.451291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:13.451291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 274/548] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:13.451756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d48c0-513a-4123-83fd-de1bbd00f6b0 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:13.465778 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290df6f5-46ca-4f0a-8708-de939a227b9c None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:13.475719 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:13.499434 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:13.501501 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf60e9-b801-4679-945f-5fac985bccb0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ui2d6DW-RGCs_ZHiIKPK0A, audit_chain_id=['Ui2d6DW-RGCs_ZHiIKPK0A']) at 0x7f8a0fdcda60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:13.502194 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf60e9-b801-4679-945f-5fac985bccb0 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.502482 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf60e9-b801-4679-945f-5fac985bccb0 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.502758 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf60e9-b801-4679-945f-5fac985bccb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:13.513534 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf60e9-b801-4679-945f-5fac985bccb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:13.515017 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf60e9-b801-4679-945f-5fac985bccb0 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:13.530460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-5cbf60e9-b801-4679-945f-5fac985bccb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:13.530460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:13.530460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:13.530460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:13.530460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:13.530460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:13.530460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:13.530460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:13.530460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:13.530460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:13.530460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:13.530460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:13.530460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:13.530460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:13.530460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:13.531359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:13.531359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:13.531359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:13.531359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:13.531359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:13.531359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:13.531359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:13.531359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:13.531359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:13.531359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:13.531359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:13.531359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:13.531359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:13.531359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:13.531359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:13.531359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:13.531359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:13.532194 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:13.532194 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:13.532194 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:13.532194 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:13.532194 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 275/549] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:13.532768 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d53a37-123c-4a9c-9b7b-252671e8e2d9 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.533052 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d53a37-123c-4a9c-9b7b-252671e8e2d9 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.533330 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d53a37-123c-4a9c-9b7b-252671e8e2d9 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:13.534757 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 276/550] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:13.535283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d53a37-123c-4a9c-9b7b-252671e8e2d9 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:13.560160 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d48c0-513a-4123-83fd-de1bbd00f6b0 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:13.595583 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975f4ea-8f1f-4115-bfdb-0e12edb94abe None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_hsM7DX7TWWOdHTra_h2lQ, audit_chain_id=['_hsM7DX7TWWOdHTra_h2lQ']) at 0x7f8a0fd1c760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:13.596536 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975f4ea-8f1f-4115-bfdb-0e12edb94abe None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.596823 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975f4ea-8f1f-4115-bfdb-0e12edb94abe None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.597102 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975f4ea-8f1f-4115-bfdb-0e12edb94abe None admin] PATH_INFO: `/v3/roles/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:13.607312 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975f4ea-8f1f-4115-bfdb-0e12edb94abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:13.612173 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-2975f4ea-8f1f-4115-bfdb-0e12edb94abe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:13.612173 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:13.612173 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:13.612173 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:13.612173 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:13.612173 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:13.612173 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:13.612173 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:13.612173 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:13.612173 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:13.612173 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:13.612173 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:13.612173 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:13.612173 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:13.612173 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:13.612173 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:13.613772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:13.613772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:13.613772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:13.613772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:13.613772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:13.613772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:13.613772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:13.613772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:13.613772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:13.613772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:13.613772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:13.613772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:13.613772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:13.613772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:13.613772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:13.613772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:13.614777 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:13.614777 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:13.614777 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:13.614777 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:13.614777 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:13.614777 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:13.614777 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:13.614777 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:13.614777 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:13.614777 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:13.614777 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:13.614777 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:13.614777 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 275/551] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 22:48:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:13.615457 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bec4fe-4c2e-47bd-95d0-a3687db6e285 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.615457 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bec4fe-4c2e-47bd-95d0-a3687db6e285 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.615581 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bec4fe-4c2e-47bd-95d0-a3687db6e285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:13.632402 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-c2bec4fe-4c2e-47bd-95d0-a3687db6e285 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:13.633620 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-c2bec4fe-4c2e-47bd-95d0-a3687db6e285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:13.644550 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d53a37-123c-4a9c-9b7b-252671e8e2d9 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:13.678083 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46791f8f-b013-412f-81bf-ed1291cd6a7c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xb3RXjPqRtes9217cO6-Nw, audit_chain_id=['xb3RXjPqRtes9217cO6-Nw']) at 0x7f8a0fe3bac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:13.678701 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46791f8f-b013-412f-81bf-ed1291cd6a7c None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.678983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46791f8f-b013-412f-81bf-ed1291cd6a7c None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.679259 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46791f8f-b013-412f-81bf-ed1291cd6a7c None admin] PATH_INFO: `/v3/projects` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:13.679996 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46791f8f-b013-412f-81bf-ed1291cd6a7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:13.680303 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46791f8f-b013-412f-81bf-ed1291cd6a7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:13.681762 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46791f8f-b013-412f-81bf-ed1291cd6a7c None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:13.693866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 277/552] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:13.694578 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46791f8f-b013-412f-81bf-ed1291cd6a7c None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:13.704311 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 276/553] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:48:13.705781 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bec4fe-4c2e-47bd-95d0-a3687db6e285 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:13.720860 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:13.737010 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:13.800644 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46791f8f-b013-412f-81bf-ed1291cd6a7c None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:13.805949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bec4fe-4c2e-47bd-95d0-a3687db6e285 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:13.834380 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcfb4b-5729-46e2-a78b-6ddd7df90b6a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ui2d6DW-RGCs_ZHiIKPK0A, audit_chain_id=['Ui2d6DW-RGCs_ZHiIKPK0A']) at 0x7f8a0fdc0d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:13.835262 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcfb4b-5729-46e2-a78b-6ddd7df90b6a None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.835262 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcfb4b-5729-46e2-a78b-6ddd7df90b6a None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.835558 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcfb4b-5729-46e2-a78b-6ddd7df90b6a None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:13.836211 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddcfb4b-5729-46e2-a78b-6ddd7df90b6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:13.836517 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddcfb4b-5729-46e2-a78b-6ddd7df90b6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:13.837919 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddcfb4b-5729-46e2-a78b-6ddd7df90b6a None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:13.840703 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a3401-f937-40ae-89c4-57cd6c220b76 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_hsM7DX7TWWOdHTra_h2lQ, audit_chain_id=['_hsM7DX7TWWOdHTra_h2lQ']) at 0x7f8a0fd88220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:13.841321 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a3401-f937-40ae-89c4-57cd6c220b76 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.841630 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a3401-f937-40ae-89c4-57cd6c220b76 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.841910 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a3401-f937-40ae-89c4-57cd6c220b76 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:13.842620 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a3401-f937-40ae-89c4-57cd6c220b76 None admin] RBAC: Adding query filter params (name=service) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:13.842929 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a3401-f937-40ae-89c4-57cd6c220b76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:13.844275 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a3401-f937-40ae-89c4-57cd6c220b76 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:13.849936 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 278/554] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:13.850703 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcfb4b-5729-46e2-a78b-6ddd7df90b6a None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:13.852382 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 277/555] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 22:48:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:13.854657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a3401-f937-40ae-89c4-57cd6c220b76 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:13.933947 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:13.948982 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:13.954401 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcfb4b-5729-46e2-a78b-6ddd7df90b6a None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:13.956028 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a3401-f937-40ae-89c4-57cd6c220b76 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:13.986981 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0f919-8f24-4c3d-9e9b-869225adca4c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xb3RXjPqRtes9217cO6-Nw, audit_chain_id=['xb3RXjPqRtes9217cO6-Nw']) at 0x7f8a0fe964f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:13.987671 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0f919-8f24-4c3d-9e9b-869225adca4c None admin] REQUEST_METHOD: `PUT` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.987955 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0f919-8f24-4c3d-9e9b-869225adca4c None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.988233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0f919-8f24-4c3d-9e9b-869225adca4c None admin] PATH_INFO: `/v3/projects/2d1b44363d694c60867ec29af4f9d01e/users/a2528d7506a5481f8fa6bb5012b4a9dd/roles/b50669f613ba46d78e9cb6c7e420b140` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:13.989859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19ba79-e3b0-4f89-8f83-592db5c1cd69 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Gh-FJZKiR-6_wNDSYXM0Cg, audit_chain_id=['Gh-FJZKiR-6_wNDSYXM0Cg']) at 0x7f8a0fd41460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:13.990502 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19ba79-e3b0-4f89-8f83-592db5c1cd69 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:13.990785 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19ba79-e3b0-4f89-8f83-592db5c1cd69 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:13.991061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19ba79-e3b0-4f89-8f83-592db5c1cd69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:14.001752 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19ba79-e3b0-4f89-8f83-592db5c1cd69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:14.002896 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0f919-8f24-4c3d-9e9b-869225adca4c None admin] RBAC: Authorizing `identity:create_grant(project_id=2d1b44363d694c60867ec29af4f9d01e, user_id=a2528d7506a5481f8fa6bb5012b4a9dd, role_id=b50669f613ba46d78e9cb6c7e420b140)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:14.004339 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0f919-8f24-4c3d-9e9b-869225adca4c None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:14.006978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-4f19ba79-e3b0-4f89-8f83-592db5c1cd69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:14.006978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:14.006978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:14.006978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:14.006978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:14.006978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:14.006978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:14.006978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:14.006978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:14.006978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:14.006978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:14.006978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:14.006978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:14.006978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:14.006978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:14.006978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:14.007851 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:14.007851 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:14.007851 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:14.007851 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:14.007851 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:14.007851 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:14.007851 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:14.007851 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:14.007851 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:14.007851 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:14.007851 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:14.007851 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:14.007851 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:14.007851 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:14.007851 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:14.007851 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:14.008657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:14.008657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:14.008657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:14.008657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:14.008657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:14.008657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:14.008657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:14.008657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:14.008657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:14.008657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:14.008657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:14.008657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:14.008657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 278/556] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 22:48:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:14.009399 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19ba79-e3b0-4f89-8f83-592db5c1cd69 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:14.020833 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 279/557] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 22:48:13 2022] PUT /identity/v3/projects/2d1b44363d694c60867ec29af4f9d01e/users/a2528d7506a5481f8fa6bb5012b4a9dd/roles/b50669f613ba46d78e9cb6c7e420b140 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:48:14.021678 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0f919-8f24-4c3d-9e9b-869225adca4c None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:14.138321 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0f919-8f24-4c3d-9e9b-869225adca4c None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:14.142994 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19ba79-e3b0-4f89-8f83-592db5c1cd69 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:14.171751 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:14.181701 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342e174-9856-4c4d-bb8e-be9ae4a5bb4f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_hsM7DX7TWWOdHTra_h2lQ, audit_chain_id=['_hsM7DX7TWWOdHTra_h2lQ']) at 0x7f8a0fdff1c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:14.181986 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c7643-d28b-41a6-ac0c-5a13afe86885 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ui2d6DW-RGCs_ZHiIKPK0A, audit_chain_id=['Ui2d6DW-RGCs_ZHiIKPK0A']) at 0x7f8a0fd6fca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:14.182405 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342e174-9856-4c4d-bb8e-be9ae4a5bb4f None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:14.182725 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c7643-d28b-41a6-ac0c-5a13afe86885 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:14.182837 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342e174-9856-4c4d-bb8e-be9ae4a5bb4f None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:14.182917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c7643-d28b-41a6-ac0c-5a13afe86885 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:14.182998 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342e174-9856-4c4d-bb8e-be9ae4a5bb4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:14.183302 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c7643-d28b-41a6-ac0c-5a13afe86885 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:14.193218 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c7643-d28b-41a6-ac0c-5a13afe86885 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:14.194650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c7643-d28b-41a6-ac0c-5a13afe86885 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:14.199765 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342e174-9856-4c4d-bb8e-be9ae4a5bb4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:14.201235 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342e174-9856-4c4d-bb8e-be9ae4a5bb4f None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:14.210420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-695c7643-d28b-41a6-ac0c-5a13afe86885 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:48:14.210420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:14.210420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:14.210420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:14.210420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:14.210420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:14.210420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:14.210420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:14.210420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:14.210420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:14.210420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:14.210420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:14.210420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:14.210420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:14.210420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:14.210420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:14.211375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:14.211375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:14.211375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:14.211375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:14.211375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:14.211375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:14.211375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:14.211375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:14.211375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:14.211375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:14.211375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:14.211375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:14.211375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:14.211375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:14.211375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:14.211375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:14.211375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:14.211375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:14.212307 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:14.212307 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:14.212307 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:14.212307 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:14.212307 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:14.212307 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:14.212307 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:14.212307 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:14.212307 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:48:14.212307 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:14.212888 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 279/558] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:48:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:14.213596 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c7643-d28b-41a6-ac0c-5a13afe86885 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:14.223345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-d342e174-9856-4c4d-bb8e-be9ae4a5bb4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:14.223345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:14.223345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:14.223345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:14.223345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:14.223345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:14.223345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:14.223345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:14.223345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:14.223345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:14.223345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:14.223345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:14.223345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:14.223345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:14.223345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:14.225156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:14.225156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:14.225156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:14.225156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:14.225156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:14.225156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:14.225156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:14.225156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:14.225156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:14.225156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:14.225156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:14.225156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:14.225156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:14.225156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:14.225156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:14.225156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:14.225156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:14.227448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:14.227448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:14.227448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:14.227448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:14.227448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 280/559] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:14.227448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342e174-9856-4c4d-bb8e-be9ae4a5bb4f None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:14.236621 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:14.322101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c7643-d28b-41a6-ac0c-5a13afe86885 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:14.342179 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342e174-9856-4c4d-bb8e-be9ae4a5bb4f None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:14.357516 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3d850-db09-43d2-81a2-4e3eb901f268 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Gh-FJZKiR-6_wNDSYXM0Cg, audit_chain_id=['Gh-FJZKiR-6_wNDSYXM0Cg']) at 0x7f8a0fd70c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:14.358164 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3d850-db09-43d2-81a2-4e3eb901f268 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:14.358445 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3d850-db09-43d2-81a2-4e3eb901f268 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:14.358715 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3d850-db09-43d2-81a2-4e3eb901f268 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:14.359425 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3d850-db09-43d2-81a2-4e3eb901f268 None admin] RBAC: Adding query filter params (name=service) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:14.359727 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3d850-db09-43d2-81a2-4e3eb901f268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:14.361103 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3d850-db09-43d2-81a2-4e3eb901f268 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:14.373530 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 280/560] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 22:48:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:14.373530 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3d850-db09-43d2-81a2-4e3eb901f268 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:14.383535 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bba8aa-d70e-4cbc-bf39-74a1a3ecdad5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ui2d6DW-RGCs_ZHiIKPK0A, audit_chain_id=['Ui2d6DW-RGCs_ZHiIKPK0A']) at 0x7f8a0fd144f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:14.384162 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bba8aa-d70e-4cbc-bf39-74a1a3ecdad5 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:14.384453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bba8aa-d70e-4cbc-bf39-74a1a3ecdad5 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:14.384722 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bba8aa-d70e-4cbc-bf39-74a1a3ecdad5 None admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:14.386162 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bba8aa-d70e-4cbc-bf39-74a1a3ecdad5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:14.386475 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bba8aa-d70e-4cbc-bf39-74a1a3ecdad5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:14.387931 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bba8aa-d70e-4cbc-bf39-74a1a3ecdad5 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:14.407719 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 281/561] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Jul 25 22:48:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:14.410622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bba8aa-d70e-4cbc-bf39-74a1a3ecdad5 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:14.454893 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:14.466167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:14.491503 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3d850-db09-43d2-81a2-4e3eb901f268 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:14.520262 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bba8aa-d70e-4cbc-bf39-74a1a3ecdad5 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:14.529796 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb5850-0a2e-4112-bf91-3a252120bbb1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_hsM7DX7TWWOdHTra_h2lQ, audit_chain_id=['_hsM7DX7TWWOdHTra_h2lQ']) at 0x7f8a0fd62c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:14.530428 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5850-0a2e-4112-bf91-3a252120bbb1 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:14.531072 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5850-0a2e-4112-bf91-3a252120bbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:14.531357 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5850-0a2e-4112-bf91-3a252120bbb1 None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:14.532366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb5850-0a2e-4112-bf91-3a252120bbb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:14.532685 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb5850-0a2e-4112-bf91-3a252120bbb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:14.534253 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb5850-0a2e-4112-bf91-3a252120bbb1 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:14.547573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 281/562] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:14.548393 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb5850-0a2e-4112-bf91-3a252120bbb1 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:14.564985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc14526-9cb2-479c-8b90-690865c16a52 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Gh-FJZKiR-6_wNDSYXM0Cg, audit_chain_id=['Gh-FJZKiR-6_wNDSYXM0Cg']) at 0x7f8a0fd64fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:14.565770 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc14526-9cb2-479c-8b90-690865c16a52 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:14.566051 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc14526-9cb2-479c-8b90-690865c16a52 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:14.566357 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc14526-9cb2-479c-8b90-690865c16a52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:14.578848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc14526-9cb2-479c-8b90-690865c16a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:14.580585 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc14526-9cb2-479c-8b90-690865c16a52 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:14.597409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-6dc14526-9cb2-479c-8b90-690865c16a52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:14.597409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:14.597409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:14.597409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:14.597409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:14.597409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:14.597409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:14.597409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:14.597409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:14.597409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:14.597409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:14.597409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:14.597409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:14.597409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:14.597409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:14.598530 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:14.598530 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:14.598530 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:14.598530 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:14.598530 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:14.598530 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:14.598530 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:14.598530 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:14.598530 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:14.598530 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:14.598530 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:14.598530 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:14.598530 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:14.598530 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:14.598530 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:14.598530 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:14.598530 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:14.599623 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:14.599623 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:14.599623 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:14.599623 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:14.603065 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 282/563] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:14.603065 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc14526-9cb2-479c-8b90-690865c16a52 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:14.665859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb5850-0a2e-4112-bf91-3a252120bbb1 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:14.696161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:14.706288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66e8c6-8fcb-4b14-b574-ee7aa4bc062d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ui2d6DW-RGCs_ZHiIKPK0A, audit_chain_id=['Ui2d6DW-RGCs_ZHiIKPK0A']) at 0x7f8a0fd88940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:14.707343 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc14526-9cb2-479c-8b90-690865c16a52 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:14.707781 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66e8c6-8fcb-4b14-b574-ee7aa4bc062d None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:14.708266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66e8c6-8fcb-4b14-b574-ee7aa4bc062d None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:14.709005 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66e8c6-8fcb-4b14-b574-ee7aa4bc062d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:14.712807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:14.723165 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66e8c6-8fcb-4b14-b574-ee7aa4bc062d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:14.725152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66e8c6-8fcb-4b14-b574-ee7aa4bc062d None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:14.740789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-ef66e8c6-8fcb-4b14-b574-ee7aa4bc062d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:14.740789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:14.740789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:14.740789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:14.740789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:14.740789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:14.740789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:14.740789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:14.740789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:14.740789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:14.740789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:14.740789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:14.740789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:14.740789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:14.740789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:14.741945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:14.741945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:14.741945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:14.741945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:14.741945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:14.741945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:14.741945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:14.741945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:14.741945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:14.741945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:14.741945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:14.741945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:14.741945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:14.741945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:14.741945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:14.741945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:14.741945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:14.743055 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:14.743055 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:14.743055 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:14.743055 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:14.743593 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 282/564] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:14.744341 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66e8c6-8fcb-4b14-b574-ee7aa4bc062d None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:14.752607 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096acb39-0ba6-40aa-bf6e-bb05f62cda46 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_hsM7DX7TWWOdHTra_h2lQ, audit_chain_id=['_hsM7DX7TWWOdHTra_h2lQ']) at 0x7f8a0fd296a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:14.753262 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096acb39-0ba6-40aa-bf6e-bb05f62cda46 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:14.753542 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096acb39-0ba6-40aa-bf6e-bb05f62cda46 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:14.753848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096acb39-0ba6-40aa-bf6e-bb05f62cda46 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:14.763111 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096acb39-0ba6-40aa-bf6e-bb05f62cda46 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:14.764375 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096acb39-0ba6-40aa-bf6e-bb05f62cda46 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:14.776172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-096acb39-0ba6-40aa-bf6e-bb05f62cda46 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:48:14.776172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:14.776172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:14.776172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:14.776172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:14.776172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:14.776172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:14.776172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:14.776172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:14.776172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:14.776172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:14.776172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:14.776172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:14.776172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:14.776172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:14.776172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:14.777305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:14.777305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:14.777305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:14.777305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:14.777305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:14.777305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:14.777305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:14.777305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:14.777305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:14.777305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:14.777305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:14.777305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:14.777305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:14.777305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:14.777305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:14.777305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:14.777305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:14.777305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:14.778400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:14.778400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:14.778400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:14.778400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:14.778400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:14.778400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:14.778400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:14.778400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:14.778400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:48:14.778400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:14.778400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 283/565] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:48:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:14.778400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096acb39-0ba6-40aa-bf6e-bb05f62cda46 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:14.862771 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66e8c6-8fcb-4b14-b574-ee7aa4bc062d None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:14.901522 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833502f-dca0-4835-ae49-0ea3297f1945 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Gh-FJZKiR-6_wNDSYXM0Cg, audit_chain_id=['Gh-FJZKiR-6_wNDSYXM0Cg']) at 0x7f8a0fd6f910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:14.902317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833502f-dca0-4835-ae49-0ea3297f1945 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:14.902603 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833502f-dca0-4835-ae49-0ea3297f1945 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:14.902880 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833502f-dca0-4835-ae49-0ea3297f1945 None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:14.903570 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833502f-dca0-4835-ae49-0ea3297f1945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:14.903936 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833502f-dca0-4835-ae49-0ea3297f1945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:14.904102 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096acb39-0ba6-40aa-bf6e-bb05f62cda46 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:14.905363 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833502f-dca0-4835-ae49-0ea3297f1945 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:14.918654 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 283/566] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:14.919475 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833502f-dca0-4835-ae49-0ea3297f1945 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:14.944861 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad259b-15e3-48e4-8628-f1a130dfe9eb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ui2d6DW-RGCs_ZHiIKPK0A, audit_chain_id=['Ui2d6DW-RGCs_ZHiIKPK0A']) at 0x7f8a0fd2f6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:14.945641 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad259b-15e3-48e4-8628-f1a130dfe9eb None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:14.946026 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad259b-15e3-48e4-8628-f1a130dfe9eb None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:14.946371 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad259b-15e3-48e4-8628-f1a130dfe9eb None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:14.947058 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad259b-15e3-48e4-8628-f1a130dfe9eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:14.947366 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad259b-15e3-48e4-8628-f1a130dfe9eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:14.949354 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad259b-15e3-48e4-8628-f1a130dfe9eb None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:14.965975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 284/567] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:14.965975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad259b-15e3-48e4-8628-f1a130dfe9eb None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:14.977381 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:14.978078 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:15.037866 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833502f-dca0-4835-ae49-0ea3297f1945 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:15.074202 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad259b-15e3-48e4-8628-f1a130dfe9eb None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:15.075913 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e107f49-be98-4a6d-bca7-b5bf78768552 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_hsM7DX7TWWOdHTra_h2lQ, audit_chain_id=['_hsM7DX7TWWOdHTra_h2lQ']) at 0x7f8a0fd55be0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:15.077477 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e107f49-be98-4a6d-bca7-b5bf78768552 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:15.077846 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e107f49-be98-4a6d-bca7-b5bf78768552 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:15.078183 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e107f49-be98-4a6d-bca7-b5bf78768552 None admin] PATH_INFO: `/v3/users` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:15.079042 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e107f49-be98-4a6d-bca7-b5bf78768552 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:15.079420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e107f49-be98-4a6d-bca7-b5bf78768552 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:15.081018 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e107f49-be98-4a6d-bca7-b5bf78768552 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:15.102409 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 284/568] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Jul 25 22:48:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:15.103587 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e107f49-be98-4a6d-bca7-b5bf78768552 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:15.111440 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a23138-8142-4330-9848-11b1f2fdc810 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Gh-FJZKiR-6_wNDSYXM0Cg, audit_chain_id=['Gh-FJZKiR-6_wNDSYXM0Cg']) at 0x7f8a0fdc2af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:15.112114 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a23138-8142-4330-9848-11b1f2fdc810 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:15.112397 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a23138-8142-4330-9848-11b1f2fdc810 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:15.112672 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a23138-8142-4330-9848-11b1f2fdc810 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:15.120055 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a23138-8142-4330-9848-11b1f2fdc810 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:15.121610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a23138-8142-4330-9848-11b1f2fdc810 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:15.134416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-e1a23138-8142-4330-9848-11b1f2fdc810 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:48:15.134416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:15.134416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:15.134416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:15.134416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:15.134416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:15.134416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:15.134416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:15.134416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:15.134416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:15.134416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:15.134416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:15.134416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:15.134416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:15.134416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:15.134416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:15.136233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:15.136233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:15.136233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:15.136233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:15.136233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:15.136233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:15.136233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:15.136233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:15.136233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:15.136233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:15.136233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:15.136233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:15.136233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:15.136233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:15.136233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:15.136233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:15.136233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:15.136233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:15.137347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:15.137347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:15.137347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:15.137347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:15.137347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:15.137347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:15.137347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:15.137347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:15.137347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:48:15.137347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:15.137347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 285/569] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 22:48:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:15.138001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a23138-8142-4330-9848-11b1f2fdc810 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:15.217436 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:15.243164 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e107f49-be98-4a6d-bca7-b5bf78768552 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:15.252462 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:15.253119 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a23138-8142-4330-9848-11b1f2fdc810 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:15.284666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b9e2d-8a44-4a12-897e-ec81649ad89e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ui2d6DW-RGCs_ZHiIKPK0A, audit_chain_id=['Ui2d6DW-RGCs_ZHiIKPK0A']) at 0x7f8a0fe223d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:15.285496 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b9e2d-8a44-4a12-897e-ec81649ad89e None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:15.286038 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b9e2d-8a44-4a12-897e-ec81649ad89e None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:15.286251 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b9e2d-8a44-4a12-897e-ec81649ad89e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:15.291070 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a2dba-ff43-4db0-88b7-cea99b2d20d7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_hsM7DX7TWWOdHTra_h2lQ, audit_chain_id=['_hsM7DX7TWWOdHTra_h2lQ']) at 0x7f8a0fd82d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:15.291900 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a2dba-ff43-4db0-88b7-cea99b2d20d7 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:15.292261 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a2dba-ff43-4db0-88b7-cea99b2d20d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:15.292640 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a2dba-ff43-4db0-88b7-cea99b2d20d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:15.294196 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b9e2d-8a44-4a12-897e-ec81649ad89e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:15.295678 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b9e2d-8a44-4a12-897e-ec81649ad89e None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:15.303674 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a2dba-ff43-4db0-88b7-cea99b2d20d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:15.305094 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a2dba-ff43-4db0-88b7-cea99b2d20d7 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:15.307527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-f21b9e2d-8a44-4a12-897e-ec81649ad89e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:15.307527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:15.307527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:15.307527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:15.307527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:15.307527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:15.307527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:15.307527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:15.307527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:15.307527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:15.307527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:15.307527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:15.307527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:15.307527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:15.307527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:15.308733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:15.308733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:15.308733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:15.308733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:15.308733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:15.308733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:15.308733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:15.308733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:15.308733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:15.308733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:15.308733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:15.308733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:15.308733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:15.308733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:15.308733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:15.308733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:15.308733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:15.309996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:15.309996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:15.309996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:15.309996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:15.309996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:15.309996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:15.309996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:15.309996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:15.309996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 285/570] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:15.309996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b9e2d-8a44-4a12-897e-ec81649ad89e None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:15.326234 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-553a2dba-ff43-4db0-88b7-cea99b2d20d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:15.326234 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:15.326234 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:15.326234 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:15.326234 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:15.326234 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:15.326234 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:15.326234 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:15.326234 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:15.326234 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:15.326234 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:15.326234 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:15.326234 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:15.326234 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:15.326234 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:15.327344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:15.327344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:15.327344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:15.327344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:15.327344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:15.327344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:15.327344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:15.327344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:15.327344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:15.327344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:15.327344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:15.327344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:15.327344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:15.327344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:15.327344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:15.327344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:15.327344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:15.328267 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:15.328267 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:15.328267 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:15.328267 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:15.328267 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 286/571] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:15.328558 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a2dba-ff43-4db0-88b7-cea99b2d20d7 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:15.427171 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b9e2d-8a44-4a12-897e-ec81649ad89e None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:15.439592 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a2dba-ff43-4db0-88b7-cea99b2d20d7 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:15.463003 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf28a11-4516-4b7f-a9fb-1d167dd0bf64 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Gh-FJZKiR-6_wNDSYXM0Cg, audit_chain_id=['Gh-FJZKiR-6_wNDSYXM0Cg']) at 0x7f8a0fd70910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:15.463778 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf28a11-4516-4b7f-a9fb-1d167dd0bf64 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:15.464158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf28a11-4516-4b7f-a9fb-1d167dd0bf64 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:15.464442 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf28a11-4516-4b7f-a9fb-1d167dd0bf64 None admin] PATH_INFO: `/v3/users` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:15.465233 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf28a11-4516-4b7f-a9fb-1d167dd0bf64 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:15.465546 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf28a11-4516-4b7f-a9fb-1d167dd0bf64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:15.467006 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf28a11-4516-4b7f-a9fb-1d167dd0bf64 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:15.470437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:15.487288 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e49e4-66e1-4bab-8053-f8950eb70bd2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ui2d6DW-RGCs_ZHiIKPK0A, audit_chain_id=['Ui2d6DW-RGCs_ZHiIKPK0A']) at 0x7f8a0fdd0970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:15.487955 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e49e4-66e1-4bab-8053-f8950eb70bd2 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:15.488240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e49e4-66e1-4bab-8053-f8950eb70bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:15.488514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e49e4-66e1-4bab-8053-f8950eb70bd2 None admin] PATH_INFO: `/v3/projects` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:15.489359 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e49e4-66e1-4bab-8053-f8950eb70bd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:15.489720 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e49e4-66e1-4bab-8053-f8950eb70bd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:15.491275 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e49e4-66e1-4bab-8053-f8950eb70bd2 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:15.493261 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 286/572] 10.222.0.47 () {56 vars in 1139 bytes} [Mon Jul 25 22:48:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:15.494269 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf28a11-4516-4b7f-a9fb-1d167dd0bf64 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:15.509447 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 287/573] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:15.509447 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e49e4-66e1-4bab-8053-f8950eb70bd2 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:15.525868 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:15.612039 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf28a11-4516-4b7f-a9fb-1d167dd0bf64 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:15.627990 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e49e4-66e1-4bab-8053-f8950eb70bd2 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:15.650022 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d4276-0fd5-4ec7-b731-cecb6ee9e35a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_hsM7DX7TWWOdHTra_h2lQ, audit_chain_id=['_hsM7DX7TWWOdHTra_h2lQ']) at 0x7f8a0fc83d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:15.650676 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d4276-0fd5-4ec7-b731-cecb6ee9e35a None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:15.651453 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d4276-0fd5-4ec7-b731-cecb6ee9e35a None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:15.651735 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d4276-0fd5-4ec7-b731-cecb6ee9e35a None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:15.652587 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d4276-0fd5-4ec7-b731-cecb6ee9e35a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:15.652944 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d4276-0fd5-4ec7-b731-cecb6ee9e35a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:15.654374 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d4276-0fd5-4ec7-b731-cecb6ee9e35a None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:15.667586 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de713c6c-396d-4616-85a8-40e38453f041 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Gh-FJZKiR-6_wNDSYXM0Cg, audit_chain_id=['Gh-FJZKiR-6_wNDSYXM0Cg']) at 0x7f8a0fd1e940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:15.672143 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 287/574] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:15.672273 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de713c6c-396d-4616-85a8-40e38453f041 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:15.672273 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de713c6c-396d-4616-85a8-40e38453f041 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:15.672439 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d4276-0fd5-4ec7-b731-cecb6ee9e35a None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:15.672528 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de713c6c-396d-4616-85a8-40e38453f041 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:15.683197 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de713c6c-396d-4616-85a8-40e38453f041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:15.684742 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de713c6c-396d-4616-85a8-40e38453f041 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:15.700268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-de713c6c-396d-4616-85a8-40e38453f041 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:15.700268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:15.700268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:15.700268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:15.700268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:15.700268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:15.700268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:15.700268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:15.700268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:15.700268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:15.700268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:15.700268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:15.700268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:15.700268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:15.700268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:15.701154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:15.701154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:15.701154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:15.701154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:15.701154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:15.701154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:15.701154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:15.701154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:15.701154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:15.701154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:15.701154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:15.701154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:15.701154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:15.701154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:15.701154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:15.701154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:15.701154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:15.702724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:15.702724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:15.702724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:15.702724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:15.702724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 288/575] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:15.702724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de713c6c-396d-4616-85a8-40e38453f041 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:15.739640 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:15.770516 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:15.788998 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d4276-0fd5-4ec7-b731-cecb6ee9e35a None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:15.809057 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de713c6c-396d-4616-85a8-40e38453f041 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:15.825861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3706cb-74ae-4058-9a9b-6309b89723a2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ui2d6DW-RGCs_ZHiIKPK0A, audit_chain_id=['Ui2d6DW-RGCs_ZHiIKPK0A']) at 0x7f8a0fd0cf10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:15.826543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3706cb-74ae-4058-9a9b-6309b89723a2 None admin] REQUEST_METHOD: `PUT` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:15.826831 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3706cb-74ae-4058-9a9b-6309b89723a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:15.827162 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3706cb-74ae-4058-9a9b-6309b89723a2 None admin] PATH_INFO: `/v3/projects/2d1b44363d694c60867ec29af4f9d01e/users/bea7c9ce1d3c4fe983e5944e5f92ff91/roles/b50669f613ba46d78e9cb6c7e420b140` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:15.843032 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3706cb-74ae-4058-9a9b-6309b89723a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d1b44363d694c60867ec29af4f9d01e, user_id=bea7c9ce1d3c4fe983e5944e5f92ff91, role_id=b50669f613ba46d78e9cb6c7e420b140)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:15.844543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3706cb-74ae-4058-9a9b-6309b89723a2 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:15.845939 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502b746-15ca-4d07-8a19-d0ccdf3a78c7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_hsM7DX7TWWOdHTra_h2lQ, audit_chain_id=['_hsM7DX7TWWOdHTra_h2lQ']) at 0x7f8a0fdff220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:15.846591 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502b746-15ca-4d07-8a19-d0ccdf3a78c7 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:15.846881 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502b746-15ca-4d07-8a19-d0ccdf3a78c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:15.847160 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502b746-15ca-4d07-8a19-d0ccdf3a78c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:15.855335 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502b746-15ca-4d07-8a19-d0ccdf3a78c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:15.856796 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502b746-15ca-4d07-8a19-d0ccdf3a78c7 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:15.859427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 288/576] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 22:48:15 2022] PUT /identity/v3/projects/2d1b44363d694c60867ec29af4f9d01e/users/bea7c9ce1d3c4fe983e5944e5f92ff91/roles/b50669f613ba46d78e9cb6c7e420b140 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:48:15.860323 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3706cb-74ae-4058-9a9b-6309b89723a2 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:15.881529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-6502b746-15ca-4d07-8a19-d0ccdf3a78c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:15.881529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:15.881529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:15.881529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:15.881529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:15.881529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:15.881529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:15.881529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:15.881529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:15.881529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:15.881529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:15.881529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:15.881529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:15.881529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:15.881529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:15.882724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:15.882724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:15.882724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:15.882724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:15.882724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:15.882724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:15.882724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:15.882724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:15.882724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:15.882724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:15.882724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:15.882724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:15.882724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:15.882724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:15.882724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:15.882724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:15.882724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:15.883953 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:15.883953 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:15.883953 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:15.883953 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:15.883953 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:15.883953 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:15.883953 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:15.883953 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:15.885878 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 289/577] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:15.892675 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502b746-15ca-4d07-8a19-d0ccdf3a78c7 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:16.005246 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3706cb-74ae-4058-9a9b-6309b89723a2 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:16.015714 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:16.023896 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502b746-15ca-4d07-8a19-d0ccdf3a78c7 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:16.047746 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767482e8-3c79-4f39-89fd-8a759e742ac8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Gh-FJZKiR-6_wNDSYXM0Cg, audit_chain_id=['Gh-FJZKiR-6_wNDSYXM0Cg']) at 0x7f8a0fd42b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:16.048258 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767482e8-3c79-4f39-89fd-8a759e742ac8 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:16.048647 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767482e8-3c79-4f39-89fd-8a759e742ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:16.049031 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767482e8-3c79-4f39-89fd-8a759e742ac8 None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:16.049915 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767482e8-3c79-4f39-89fd-8a759e742ac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:16.050325 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767482e8-3c79-4f39-89fd-8a759e742ac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:16.051817 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767482e8-3c79-4f39-89fd-8a759e742ac8 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:16.053614 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:16.064758 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a65e4d-e91e-4ce0-908c-918825ddde9f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_hsM7DX7TWWOdHTra_h2lQ, audit_chain_id=['_hsM7DX7TWWOdHTra_h2lQ']) at 0x7f8a0fdc3550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:16.065397 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a65e4d-e91e-4ce0-908c-918825ddde9f None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:16.065736 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a65e4d-e91e-4ce0-908c-918825ddde9f None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:16.066016 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a65e4d-e91e-4ce0-908c-918825ddde9f None admin] PATH_INFO: `/v3/projects` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:16.066999 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a65e4d-e91e-4ce0-908c-918825ddde9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:16.067107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a65e4d-e91e-4ce0-908c-918825ddde9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:16.067831 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 289/578] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:16.068755 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a65e4d-e91e-4ce0-908c-918825ddde9f None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:16.074015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767482e8-3c79-4f39-89fd-8a759e742ac8 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:16.082921 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 290/579] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:16.090393 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a65e4d-e91e-4ce0-908c-918825ddde9f None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:16.197937 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767482e8-3c79-4f39-89fd-8a759e742ac8 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:16.227030 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a65e4d-e91e-4ce0-908c-918825ddde9f None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:16.240656 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebea052-7c62-47f7-b216-d2faceaef047 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Gh-FJZKiR-6_wNDSYXM0Cg, audit_chain_id=['Gh-FJZKiR-6_wNDSYXM0Cg']) at 0x7f8a0fdc4250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:16.241618 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebea052-7c62-47f7-b216-d2faceaef047 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:16.242045 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebea052-7c62-47f7-b216-d2faceaef047 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:16.242335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebea052-7c62-47f7-b216-d2faceaef047 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:16.251994 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebea052-7c62-47f7-b216-d2faceaef047 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:16.253800 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebea052-7c62-47f7-b216-d2faceaef047 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:16.267412 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de8e62-4286-4131-a5f1-c01e8e8f3101 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_hsM7DX7TWWOdHTra_h2lQ, audit_chain_id=['_hsM7DX7TWWOdHTra_h2lQ']) at 0x7f8a0fe3ba90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:16.268395 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de8e62-4286-4131-a5f1-c01e8e8f3101 None admin] REQUEST_METHOD: `PUT` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:16.268885 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de8e62-4286-4131-a5f1-c01e8e8f3101 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:16.269058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-7ebea052-7c62-47f7-b216-d2faceaef047 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:16.269058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:16.269058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:16.269058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:16.269058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:16.269058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:16.269058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:16.269058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:16.269058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:16.269058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:16.269058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:16.269058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:16.269058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:16.269058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:16.269058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:16.270037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:16.270037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:16.270037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:16.270037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:16.270037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:16.270037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:16.270037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:16.270037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:16.270037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:16.270037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:16.270037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:16.270037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:16.270037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:16.270037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:16.270037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:16.270037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:16.270037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:16.271329 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:16.271329 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:16.271329 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:16.271329 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:16.271329 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:16.271329 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:16.271329 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:16.271329 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:16.272421 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de8e62-4286-4131-a5f1-c01e8e8f3101 None admin] PATH_INFO: `/v3/projects/2d1b44363d694c60867ec29af4f9d01e/users/cc1a058881084fbdbf53096109e5381f/roles/b50669f613ba46d78e9cb6c7e420b140` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:16.275125 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 290/580] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:48:16.276325 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebea052-7c62-47f7-b216-d2faceaef047 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:16.289264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de8e62-4286-4131-a5f1-c01e8e8f3101 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d1b44363d694c60867ec29af4f9d01e, user_id=cc1a058881084fbdbf53096109e5381f, role_id=b50669f613ba46d78e9cb6c7e420b140)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:16.291271 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de8e62-4286-4131-a5f1-c01e8e8f3101 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:16.308037 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 291/581] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 22:48:16 2022] PUT /identity/v3/projects/2d1b44363d694c60867ec29af4f9d01e/users/cc1a058881084fbdbf53096109e5381f/roles/b50669f613ba46d78e9cb6c7e420b140 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:48:16.309777 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1736319-cf34-49fe-b53b-a8dc69ef4aa9 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:16.310281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1736319-cf34-49fe-b53b-a8dc69ef4aa9 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:16.310558 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1736319-cf34-49fe-b53b-a8dc69ef4aa9 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:16.311978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 292/582] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:16.317507 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5396a-e480-4581-bdaa-2659866d057e None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:16.317830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5396a-e480-4581-bdaa-2659866d057e None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:16.318102 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5396a-e480-4581-bdaa-2659866d057e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:16.334209 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:16.341954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-9cb5396a-e480-4581-bdaa-2659866d057e None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:16.343639 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-9cb5396a-e480-4581-bdaa-2659866d057e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:16.357222 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:16.412971 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebea052-7c62-47f7-b216-d2faceaef047 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:16.446316 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 293/583] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:48:16.470509 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb30bd8-0cd8-46fa-b6f5-2f3d0b78502a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Gh-FJZKiR-6_wNDSYXM0Cg, audit_chain_id=['Gh-FJZKiR-6_wNDSYXM0Cg']) at 0x7f8a0fd706a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:16.471601 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb30bd8-0cd8-46fa-b6f5-2f3d0b78502a None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:16.472088 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb30bd8-0cd8-46fa-b6f5-2f3d0b78502a None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:16.472571 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb30bd8-0cd8-46fa-b6f5-2f3d0b78502a None admin] PATH_INFO: `/v3/projects` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:16.473598 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb30bd8-0cd8-46fa-b6f5-2f3d0b78502a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:16.474125 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb30bd8-0cd8-46fa-b6f5-2f3d0b78502a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:16.475848 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb30bd8-0cd8-46fa-b6f5-2f3d0b78502a None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:16.484578 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5396a-e480-4581-bdaa-2659866d057e None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:16.497592 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 291/584] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:16.504751 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb30bd8-0cd8-46fa-b6f5-2f3d0b78502a None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:16.627964 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5396a-e480-4581-bdaa-2659866d057e None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:16.629643 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb30bd8-0cd8-46fa-b6f5-2f3d0b78502a None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:16.665987 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:16.667711 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df4132-2cd9-4c5a-8661-4de7c1c9b9b0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Gh-FJZKiR-6_wNDSYXM0Cg, audit_chain_id=['Gh-FJZKiR-6_wNDSYXM0Cg']) at 0x7f8a0fd55a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:16.668383 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df4132-2cd9-4c5a-8661-4de7c1c9b9b0 None admin] REQUEST_METHOD: `PUT` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:16.669060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df4132-2cd9-4c5a-8661-4de7c1c9b9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:16.669881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df4132-2cd9-4c5a-8661-4de7c1c9b9b0 None admin] PATH_INFO: `/v3/projects/2d1b44363d694c60867ec29af4f9d01e/users/f77ef50984084af9bcd220fc68deacf8/roles/b50669f613ba46d78e9cb6c7e420b140` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:16.673368 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1661df3-9de1-4861-a503-dcf1aa6969c4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wnEnFmtCRYWJPOkRNmX18w, audit_chain_id=['wnEnFmtCRYWJPOkRNmX18w']) at 0x7f8a14e7a4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:16.674057 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1661df3-9de1-4861-a503-dcf1aa6969c4 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:16.674344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1661df3-9de1-4861-a503-dcf1aa6969c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:16.674624 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1661df3-9de1-4861-a503-dcf1aa6969c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:16.678570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:16.689756 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1661df3-9de1-4861-a503-dcf1aa6969c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:16.691383 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df4132-2cd9-4c5a-8661-4de7c1c9b9b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d1b44363d694c60867ec29af4f9d01e, user_id=f77ef50984084af9bcd220fc68deacf8, role_id=b50669f613ba46d78e9cb6c7e420b140)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:16.693035 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df4132-2cd9-4c5a-8661-4de7c1c9b9b0 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:16.694732 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-b1661df3-9de1-4861-a503-dcf1aa6969c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:16.694732 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:16.694732 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:16.694732 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:16.694732 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:16.694732 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:16.694732 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:16.694732 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:16.694732 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:16.694732 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:16.694732 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:16.694732 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:16.694732 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:16.694732 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:16.694732 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:16.694732 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:16.695828 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:16.695828 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:16.695828 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:16.695828 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:16.695828 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:16.695828 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:16.695828 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:16.695828 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:16.695828 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:16.695828 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:16.695828 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:16.695828 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:16.695828 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:16.695828 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:16.695828 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:16.695828 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:16.701591 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:16.701591 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:16.701591 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:16.701591 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:16.701591 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:16.701591 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:16.701591 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:16.701591 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:16.701591 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:16.701591 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:16.701591 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:16.701591 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:16.701591 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 294/585] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 22:48:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:48:16.704033 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1661df3-9de1-4861-a503-dcf1aa6969c4 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:16.715126 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 292/586] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 22:48:16 2022] PUT /identity/v3/projects/2d1b44363d694c60867ec29af4f9d01e/users/f77ef50984084af9bcd220fc68deacf8/roles/b50669f613ba46d78e9cb6c7e420b140 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:48:16.828514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1661df3-9de1-4861-a503-dcf1aa6969c4 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:16.868691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0ca3a-9178-4ffb-9fe3-d3f9f238c6c1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wnEnFmtCRYWJPOkRNmX18w, audit_chain_id=['wnEnFmtCRYWJPOkRNmX18w']) at 0x7f8a0fd2f580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:16.869323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0ca3a-9178-4ffb-9fe3-d3f9f238c6c1 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:16.869722 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0ca3a-9178-4ffb-9fe3-d3f9f238c6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:16.870027 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0ca3a-9178-4ffb-9fe3-d3f9f238c6c1 None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:16.870784 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0ca3a-9178-4ffb-9fe3-d3f9f238c6c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:16.871090 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0ca3a-9178-4ffb-9fe3-d3f9f238c6c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:16.872492 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0ca3a-9178-4ffb-9fe3-d3f9f238c6c1 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:16.887481 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 295/587] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 22:48:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:16.888938 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df4132-2cd9-4c5a-8661-4de7c1c9b9b0 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:17.000825 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df4132-2cd9-4c5a-8661-4de7c1c9b9b0 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:17.037202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fcd46-0ec8-48a8-a63a-dc439345d2ce None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wnEnFmtCRYWJPOkRNmX18w, audit_chain_id=['wnEnFmtCRYWJPOkRNmX18w']) at 0x7f8a0fdc1cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:17.038149 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fcd46-0ec8-48a8-a63a-dc439345d2ce None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:17.038594 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fcd46-0ec8-48a8-a63a-dc439345d2ce None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:17.039013 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fcd46-0ec8-48a8-a63a-dc439345d2ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:17.050928 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fcd46-0ec8-48a8-a63a-dc439345d2ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:17.052590 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250fcd46-0ec8-48a8-a63a-dc439345d2ce None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:17.068147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-250fcd46-0ec8-48a8-a63a-dc439345d2ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:17.068147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:17.068147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:17.068147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:17.068147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:17.068147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:17.068147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:17.068147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:17.068147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:17.068147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:17.068147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:17.068147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:17.068147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:17.068147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:17.068147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:17.069227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:17.069227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:17.069227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:17.069227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:17.069227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:17.069227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:17.069227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:17.069227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:17.069227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:17.069227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:17.069227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:17.069227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:17.069227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:17.069227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:17.069227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:17.069227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:17.069227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:17.070319 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:17.070319 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:17.070319 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:17.070319 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:17.076594 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 293/588] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:17.078200 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0ca3a-9178-4ffb-9fe3-d3f9f238c6c1 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:17.143749 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:17.188216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0ca3a-9178-4ffb-9fe3-d3f9f238c6c1 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:17.223735 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637cf63-f5e1-4efb-a79b-fb97f7d37eab None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wnEnFmtCRYWJPOkRNmX18w, audit_chain_id=['wnEnFmtCRYWJPOkRNmX18w']) at 0x7f8a0fd2feb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:17.224642 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637cf63-f5e1-4efb-a79b-fb97f7d37eab None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:17.225068 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637cf63-f5e1-4efb-a79b-fb97f7d37eab None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:17.225486 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637cf63-f5e1-4efb-a79b-fb97f7d37eab None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:17.226335 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637cf63-f5e1-4efb-a79b-fb97f7d37eab None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:17.226804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637cf63-f5e1-4efb-a79b-fb97f7d37eab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:17.228302 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637cf63-f5e1-4efb-a79b-fb97f7d37eab None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:17.245086 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 296/589] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:17.246607 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fcd46-0ec8-48a8-a63a-dc439345d2ce None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:17.266713 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:17.355990 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fcd46-0ec8-48a8-a63a-dc439345d2ce None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:17.390876 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7957be-2e41-4ffd-aef0-daf29db993bf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wnEnFmtCRYWJPOkRNmX18w, audit_chain_id=['wnEnFmtCRYWJPOkRNmX18w']) at 0x7f8a0fdcf940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:17.391515 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7957be-2e41-4ffd-aef0-daf29db993bf None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:17.391794 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7957be-2e41-4ffd-aef0-daf29db993bf None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:17.392069 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7957be-2e41-4ffd-aef0-daf29db993bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:17.399923 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7957be-2e41-4ffd-aef0-daf29db993bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:17.401960 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7957be-2e41-4ffd-aef0-daf29db993bf None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:17.413541 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-1c7957be-2e41-4ffd-aef0-daf29db993bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:48:17.413541 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:17.413541 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:17.413541 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:17.413541 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:17.413541 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:17.413541 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:17.413541 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:17.413541 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:17.413541 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:17.413541 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:17.413541 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:17.413541 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:17.413541 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:17.413541 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:17.413541 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:17.414543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:17.414543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:17.414543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:17.414543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:17.414543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:17.414543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:17.414543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:17.414543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:17.414543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:17.414543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:17.414543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:17.414543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:17.414543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:17.414543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:17.414543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:17.414543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:17.414543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:17.414543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:17.415493 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:17.415493 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:17.415493 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:17.415493 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:17.415493 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:17.415493 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:17.415493 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:17.415493 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:17.415493 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:48:17.415493 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:17.419359 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 294/590] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Jul 25 22:48:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:17.422691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637cf63-f5e1-4efb-a79b-fb97f7d37eab None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:17.539605 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637cf63-f5e1-4efb-a79b-fb97f7d37eab None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:17.561149 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:17.582876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76748c3-ac5e-478b-8b2a-2e4a8b4cd765 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wnEnFmtCRYWJPOkRNmX18w, audit_chain_id=['wnEnFmtCRYWJPOkRNmX18w']) at 0x7f8a0fdcda60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:17.583507 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76748c3-ac5e-478b-8b2a-2e4a8b4cd765 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:17.583787 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76748c3-ac5e-478b-8b2a-2e4a8b4cd765 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:17.584059 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76748c3-ac5e-478b-8b2a-2e4a8b4cd765 None admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:17.584850 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76748c3-ac5e-478b-8b2a-2e4a8b4cd765 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:17.585154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76748c3-ac5e-478b-8b2a-2e4a8b4cd765 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:17.586596 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76748c3-ac5e-478b-8b2a-2e4a8b4cd765 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:17.611244 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 297/591] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Jul 25 22:48:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:17.612590 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7957be-2e41-4ffd-aef0-daf29db993bf None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:17.699494 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:17.725257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7957be-2e41-4ffd-aef0-daf29db993bf None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:17.761467 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e50db1-428b-4c11-8aa6-4e2f8f741fbb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wnEnFmtCRYWJPOkRNmX18w, audit_chain_id=['wnEnFmtCRYWJPOkRNmX18w']) at 0x7f8a0fd62c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:17.762114 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e50db1-428b-4c11-8aa6-4e2f8f741fbb None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:17.762397 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e50db1-428b-4c11-8aa6-4e2f8f741fbb None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:17.762669 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e50db1-428b-4c11-8aa6-4e2f8f741fbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:17.837275 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e50db1-428b-4c11-8aa6-4e2f8f741fbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:17.838896 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e50db1-428b-4c11-8aa6-4e2f8f741fbb None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:17.922025 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:17.951630 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 295/592] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:48:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:48:17.956868 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76748c3-ac5e-478b-8b2a-2e4a8b4cd765 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:18.062079 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76748c3-ac5e-478b-8b2a-2e4a8b4cd765 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:18.099781 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1387b8b-4975-47c1-b63f-ed8d60db4c9e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wnEnFmtCRYWJPOkRNmX18w, audit_chain_id=['wnEnFmtCRYWJPOkRNmX18w']) at 0x7f8a0fe38820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:18.100565 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1387b8b-4975-47c1-b63f-ed8d60db4c9e None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:18.100761 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1387b8b-4975-47c1-b63f-ed8d60db4c9e None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:18.101075 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1387b8b-4975-47c1-b63f-ed8d60db4c9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:18.113290 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1387b8b-4975-47c1-b63f-ed8d60db4c9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:18.114786 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1387b8b-4975-47c1-b63f-ed8d60db4c9e None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:18.130592 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-d1387b8b-4975-47c1-b63f-ed8d60db4c9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:18.130592 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:18.130592 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:18.130592 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:18.130592 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:18.130592 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:18.130592 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:18.130592 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:18.130592 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:18.130592 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:18.130592 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:18.130592 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:18.130592 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:18.130592 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:18.130592 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:18.132816 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:18.132816 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:18.132816 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:18.132816 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:18.132816 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:18.132816 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:18.132816 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:18.132816 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:18.132816 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:18.132816 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:18.132816 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:18.132816 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:18.132816 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:18.132816 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:18.132816 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:18.132816 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:18.132816 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:18.134967 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:18.134967 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:18.134967 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:18.134967 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:18.137380 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 298/593] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:18.138658 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e50db1-428b-4c11-8aa6-4e2f8f741fbb None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:18.253357 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e50db1-428b-4c11-8aa6-4e2f8f741fbb None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:18.254164 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98498fe-092b-4894-99c8-11edfb525650 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:18.254672 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98498fe-092b-4894-99c8-11edfb525650 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:18.255145 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98498fe-092b-4894-99c8-11edfb525650 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:18.258055 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 299/594] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:18.263258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191de13-b5c0-467b-b5c1-4b96ab24d883 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:18.263795 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191de13-b5c0-467b-b5c1-4b96ab24d883 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:18.264279 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191de13-b5c0-467b-b5c1-4b96ab24d883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:18.284581 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-5191de13-b5c0-467b-b5c1-4b96ab24d883 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:18.286290 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-5191de13-b5c0-467b-b5c1-4b96ab24d883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:18.291364 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6f17b-0576-4b93-a783-26cd74474bc8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wnEnFmtCRYWJPOkRNmX18w, audit_chain_id=['wnEnFmtCRYWJPOkRNmX18w']) at 0x7f8a0fd42580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:18.291993 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6f17b-0576-4b93-a783-26cd74474bc8 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:18.292278 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6f17b-0576-4b93-a783-26cd74474bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:18.292557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6f17b-0576-4b93-a783-26cd74474bc8 None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:18.293245 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6f17b-0576-4b93-a783-26cd74474bc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:18.293552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6f17b-0576-4b93-a783-26cd74474bc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:18.294975 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6f17b-0576-4b93-a783-26cd74474bc8 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:18.312347 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 296/595] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:18.314583 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6f17b-0576-4b93-a783-26cd74474bc8 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:18.320012 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:18.359803 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:18.384199 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 300/596] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:48:18.406434 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191de13-b5c0-467b-b5c1-4b96ab24d883 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:18.457609 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6f17b-0576-4b93-a783-26cd74474bc8 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:18.495597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9b206-d727-49b6-9be0-69601a88f6f1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wnEnFmtCRYWJPOkRNmX18w, audit_chain_id=['wnEnFmtCRYWJPOkRNmX18w']) at 0x7f8a0fe46af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:18.496322 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9b206-d727-49b6-9be0-69601a88f6f1 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:18.496513 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9b206-d727-49b6-9be0-69601a88f6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:18.496780 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9b206-d727-49b6-9be0-69601a88f6f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:18.504001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9b206-d727-49b6-9be0-69601a88f6f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:18.505409 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9b206-d727-49b6-9be0-69601a88f6f1 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:18.519180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-35e9b206-d727-49b6-9be0-69601a88f6f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:18.519180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:18.519180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:18.519180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:18.519180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:18.519180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:18.519180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:18.519180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:18.519180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:18.519180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:18.519180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:18.519180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:18.519180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:18.519180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:18.519180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:18.520140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:18.520140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:18.520140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:18.520140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:18.520140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:18.520140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:18.520140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:18.520140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:18.520140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:18.520140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:18.520140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:18.520140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:18.520140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:18.520140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:18.520140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:18.520140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:18.520140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:18.521455 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:18.521455 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:18.521455 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:18.521455 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:18.521455 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:18.521455 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:18.521455 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:18.521455 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:18.521455 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 297/597] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:18.527340 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9b206-d727-49b6-9be0-69601a88f6f1 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:18.547404 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191de13-b5c0-467b-b5c1-4b96ab24d883 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:18.586976 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0386e-c1b6-495a-b048-3cc24baf397b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uS4KW1GTTVmx5xU6bPFWUA, audit_chain_id=['uS4KW1GTTVmx5xU6bPFWUA']) at 0x7f8a0fe38400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:18.588742 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0386e-c1b6-495a-b048-3cc24baf397b None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:18.589683 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0386e-c1b6-495a-b048-3cc24baf397b None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:18.590289 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0386e-c1b6-495a-b048-3cc24baf397b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:18.608154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0386e-c1b6-495a-b048-3cc24baf397b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:18.613876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-dbf0386e-c1b6-495a-b048-3cc24baf397b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:18.613876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:18.613876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:18.613876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:18.613876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:18.613876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:18.613876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:18.613876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:18.613876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:18.613876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:18.613876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:18.613876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:18.613876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:18.613876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:18.613876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:18.613876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:18.614803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:18.614803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:18.614803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:18.614803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:18.614803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:18.614803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:18.614803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:18.614803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:18.614803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:18.614803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:18.614803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:18.614803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:18.614803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:18.614803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:18.614803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:18.614803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:18.615623 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:18.615623 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:18.615623 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:18.615623 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:18.615623 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:18.615623 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:18.615623 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:18.615623 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:18.615623 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:18.615623 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:18.615623 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:18.615623 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:18.623224 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 301/598] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 22:48:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:48:18.624963 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0386e-c1b6-495a-b048-3cc24baf397b None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:18.629608 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:18.636147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9b206-d727-49b6-9be0-69601a88f6f1 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:18.651712 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:18.674971 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ae6c6-3033-4fc4-a723-4a5ded7f20b8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wnEnFmtCRYWJPOkRNmX18w, audit_chain_id=['wnEnFmtCRYWJPOkRNmX18w']) at 0x7f8a0fd70760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:18.675595 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ae6c6-3033-4fc4-a723-4a5ded7f20b8 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:18.675876 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ae6c6-3033-4fc4-a723-4a5ded7f20b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:18.676152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ae6c6-3033-4fc4-a723-4a5ded7f20b8 None admin] PATH_INFO: `/v3/projects` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:18.677027 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ae6c6-3033-4fc4-a723-4a5ded7f20b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:18.677337 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ae6c6-3033-4fc4-a723-4a5ded7f20b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:18.678806 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ae6c6-3033-4fc4-a723-4a5ded7f20b8 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:18.692270 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 298/599] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:18.699011 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735df1fc-3560-469d-846b-c4dff165bb22 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:18.699296 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735df1fc-3560-469d-846b-c4dff165bb22 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:18.699572 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735df1fc-3560-469d-846b-c4dff165bb22 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:18.701340 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 299/600] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:18.702107 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735df1fc-3560-469d-846b-c4dff165bb22 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:18.743234 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0386e-c1b6-495a-b048-3cc24baf397b None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:18.783516 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4da7b1-d9e8-4b4e-b53c-afe7df08255f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uS4KW1GTTVmx5xU6bPFWUA, audit_chain_id=['uS4KW1GTTVmx5xU6bPFWUA']) at 0x7f8a0fd1ec70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:18.784455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da7b1-d9e8-4b4e-b53c-afe7df08255f None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:18.784737 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da7b1-d9e8-4b4e-b53c-afe7df08255f None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:18.785011 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da7b1-d9e8-4b4e-b53c-afe7df08255f None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:18.785770 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4da7b1-d9e8-4b4e-b53c-afe7df08255f None admin] RBAC: Adding query filter params (name=service) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:18.786403 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4da7b1-d9e8-4b4e-b53c-afe7df08255f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:18.788233 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4da7b1-d9e8-4b4e-b53c-afe7df08255f None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:18.801983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 302/601] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 22:48:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:18.803372 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970c9ed-fb34-4a36-b2d8-67728f14b62b None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:18.803656 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970c9ed-fb34-4a36-b2d8-67728f14b62b None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:18.803933 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970c9ed-fb34-4a36-b2d8-67728f14b62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:18.812324 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735df1fc-3560-469d-846b-c4dff165bb22 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:18.824686 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-8970c9ed-fb34-4a36-b2d8-67728f14b62b None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:18.826256 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-8970c9ed-fb34-4a36-b2d8-67728f14b62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:18.851720 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a482b8-a679-4435-b4d2-d3d02c6afd72 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wnEnFmtCRYWJPOkRNmX18w, audit_chain_id=['wnEnFmtCRYWJPOkRNmX18w']) at 0x7f8a0fd0c520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:18.852572 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a482b8-a679-4435-b4d2-d3d02c6afd72 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:18.852857 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a482b8-a679-4435-b4d2-d3d02c6afd72 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:18.853143 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a482b8-a679-4435-b4d2-d3d02c6afd72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:18.854058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a482b8-a679-4435-b4d2-d3d02c6afd72 None admin] RBAC: Adding query filter params (role.id=b50669f613ba46d78e9cb6c7e420b140, scope.project.id=2d1b44363d694c60867ec29af4f9d01e, user.id=a2528d7506a5481f8fa6bb5012b4a9dd) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:18.854377 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a482b8-a679-4435-b4d2-d3d02c6afd72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:18.855827 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a482b8-a679-4435-b4d2-d3d02c6afd72 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:18.862125 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 300/602] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:48:18 2022] GET /identity/v3/role_assignments?user.id=a2528d7506a5481f8fa6bb5012b4a9dd&scope.project.id=2d1b44363d694c60867ec29af4f9d01e&role.id=b50669f613ba46d78e9cb6c7e420b140 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:18.862931 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a482b8-a679-4435-b4d2-d3d02c6afd72 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:18.905763 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:18.926435 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 303/603] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:48:18.951741 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970c9ed-fb34-4a36-b2d8-67728f14b62b None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:18.965271 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:19.010811 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a482b8-a679-4435-b4d2-d3d02c6afd72 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:19.051390 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbf4bc-cdfd-4448-bc71-18546fe9c276 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uS4KW1GTTVmx5xU6bPFWUA, audit_chain_id=['uS4KW1GTTVmx5xU6bPFWUA']) at 0x7f8a0fe204c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:19.051957 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbf4bc-cdfd-4448-bc71-18546fe9c276 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:19.052240 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbf4bc-cdfd-4448-bc71-18546fe9c276 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:19.052516 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbf4bc-cdfd-4448-bc71-18546fe9c276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:19.066034 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cbf4bc-cdfd-4448-bc71-18546fe9c276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:19.067492 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cbf4bc-cdfd-4448-bc71-18546fe9c276 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:19.068436 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970c9ed-fb34-4a36-b2d8-67728f14b62b None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:19.083856 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-34cbf4bc-cdfd-4448-bc71-18546fe9c276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:19.083856 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:19.083856 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:19.083856 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:19.083856 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:19.083856 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:19.083856 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:19.083856 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:19.083856 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:19.083856 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:19.083856 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:19.083856 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:19.083856 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:19.083856 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:19.083856 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:19.084990 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:19.084990 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:19.084990 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:19.084990 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:19.084990 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:19.084990 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:19.084990 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:19.084990 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:19.084990 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:19.084990 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:19.084990 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:19.084990 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:19.084990 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:19.084990 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:19.084990 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:19.084990 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:19.084990 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:19.086189 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:19.086189 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:19.086189 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:19.086189 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:19.086189 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 301/604] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:19.086533 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca20cb-aaf6-4db6-a052-4547c0064ff4 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:19.086623 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca20cb-aaf6-4db6-a052-4547c0064ff4 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:19.086888 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca20cb-aaf6-4db6-a052-4547c0064ff4 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:19.088862 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 302/605] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:19.092543 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca20cb-aaf6-4db6-a052-4547c0064ff4 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:19.109241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb4406-409a-433c-9923-1843c9c30078 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=V_tFi_-3Qn6UN1eu2EVcZw, audit_chain_id=['V_tFi_-3Qn6UN1eu2EVcZw']) at 0x7f8a0fe71ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:19.109956 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb4406-409a-433c-9923-1843c9c30078 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:19.110191 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb4406-409a-433c-9923-1843c9c30078 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:19.110463 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb4406-409a-433c-9923-1843c9c30078 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:19.121839 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb4406-409a-433c-9923-1843c9c30078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:19.126683 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-9bcb4406-409a-433c-9923-1843c9c30078 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:19.126683 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:19.126683 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:19.126683 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:19.126683 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:19.126683 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:19.126683 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:19.126683 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:19.126683 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:19.126683 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:19.126683 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:19.126683 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:19.126683 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:19.126683 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:19.126683 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:19.126683 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:19.127622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:19.127622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:19.127622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:19.127622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:19.127622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:19.127622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:19.127622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:19.127622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:19.127622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:19.127622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:19.127622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:19.127622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:19.127622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:19.127622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:19.127622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:19.127622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:19.128458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:19.128458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:19.128458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:19.128458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:19.128458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:19.128458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:19.128458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:19.128458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:19.128458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:19.128458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:19.128458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:19.128458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:19.128458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 304/606] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 22:48:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:19.129139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e18fb3-decf-4a91-8b3e-59e0f83d8550 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:19.129327 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e18fb3-decf-4a91-8b3e-59e0f83d8550 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:19.129632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e18fb3-decf-4a91-8b3e-59e0f83d8550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:19.150365 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-d5e18fb3-decf-4a91-8b3e-59e0f83d8550 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:19.151958 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-d5e18fb3-decf-4a91-8b3e-59e0f83d8550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:19.178393 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:19.213808 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca20cb-aaf6-4db6-a052-4547c0064ff4 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:19.223407 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:19.232599 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 305/607] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:48:19.232599 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e18fb3-decf-4a91-8b3e-59e0f83d8550 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:19.271855 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff2529-25eb-4de0-b77a-9c2080be5a02 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uS4KW1GTTVmx5xU6bPFWUA, audit_chain_id=['uS4KW1GTTVmx5xU6bPFWUA']) at 0x7f8a0fd2e5e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:19.272524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff2529-25eb-4de0-b77a-9c2080be5a02 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:19.272807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff2529-25eb-4de0-b77a-9c2080be5a02 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:19.273078 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff2529-25eb-4de0-b77a-9c2080be5a02 None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:19.274121 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff2529-25eb-4de0-b77a-9c2080be5a02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:19.274435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff2529-25eb-4de0-b77a-9c2080be5a02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:19.275956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff2529-25eb-4de0-b77a-9c2080be5a02 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:19.292717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 303/608] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:19.292717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff2529-25eb-4de0-b77a-9c2080be5a02 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:19.348882 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e18fb3-decf-4a91-8b3e-59e0f83d8550 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:19.386937 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226c8c8-b247-4fb0-a1d7-a86c4ea2712f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=V_tFi_-3Qn6UN1eu2EVcZw, audit_chain_id=['V_tFi_-3Qn6UN1eu2EVcZw']) at 0x7f8a0fdd9a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:19.387561 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226c8c8-b247-4fb0-a1d7-a86c4ea2712f None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:19.387841 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226c8c8-b247-4fb0-a1d7-a86c4ea2712f None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:19.388110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226c8c8-b247-4fb0-a1d7-a86c4ea2712f None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:19.388901 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226c8c8-b247-4fb0-a1d7-a86c4ea2712f None admin] RBAC: Adding query filter params (name=service) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:19.389205 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226c8c8-b247-4fb0-a1d7-a86c4ea2712f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:19.390855 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6226c8c8-b247-4fb0-a1d7-a86c4ea2712f None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:19.399606 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 306/609] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 22:48:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:19.400468 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226c8c8-b247-4fb0-a1d7-a86c4ea2712f None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:19.410953 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff2529-25eb-4de0-b77a-9c2080be5a02 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:19.445440 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:19.452097 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef540af-ff7f-4796-9d85-97f189a57ccb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0epVChhXSkaGf5hIUadhqA, audit_chain_id=['0epVChhXSkaGf5hIUadhqA']) at 0x7f8a14dd0100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:19.452762 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef540af-ff7f-4796-9d85-97f189a57ccb None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:19.453022 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef540af-ff7f-4796-9d85-97f189a57ccb None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:19.453301 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef540af-ff7f-4796-9d85-97f189a57ccb None admin] PATH_INFO: `/v3/roles/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:19.464712 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef540af-ff7f-4796-9d85-97f189a57ccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:19.469970 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-bef540af-ff7f-4796-9d85-97f189a57ccb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:19.469970 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:19.469970 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:19.469970 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:19.469970 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:19.469970 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:19.469970 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:19.469970 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:19.469970 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:19.469970 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:19.469970 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:19.469970 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:19.469970 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:19.469970 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:19.469970 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:19.469970 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:19.470879 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:19.470879 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:19.470879 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:19.470879 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:19.470879 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:19.470879 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:19.470879 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:19.470879 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:19.470879 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:19.470879 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:19.470879 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:19.470879 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:19.470879 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:19.470879 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:19.470879 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:19.470879 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:19.471714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:19.471714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:19.471714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:19.471714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:19.471714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:19.471714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:19.471714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:19.471714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:19.471714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:19.471714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:19.471714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:48:19.471714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:19.471714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 304/610] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 22:48:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:19.472390 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef540af-ff7f-4796-9d85-97f189a57ccb None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:19.478503 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:19.521165 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226c8c8-b247-4fb0-a1d7-a86c4ea2712f None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:19.555329 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9281a8-cfa8-468b-8ac5-88e6f8b96598 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uS4KW1GTTVmx5xU6bPFWUA, audit_chain_id=['uS4KW1GTTVmx5xU6bPFWUA']) at 0x7f8a14cf4850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:19.555968 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9281a8-cfa8-468b-8ac5-88e6f8b96598 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:19.556254 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9281a8-cfa8-468b-8ac5-88e6f8b96598 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:19.556541 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9281a8-cfa8-468b-8ac5-88e6f8b96598 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:19.564964 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9281a8-cfa8-468b-8ac5-88e6f8b96598 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:19.566426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9281a8-cfa8-468b-8ac5-88e6f8b96598 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:19.578157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-2d9281a8-cfa8-468b-8ac5-88e6f8b96598 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:48:19.578157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:19.578157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:19.578157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:19.578157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:19.578157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:19.578157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:19.578157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:19.578157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:19.578157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:19.578157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:19.578157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:19.578157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:19.578157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:19.578157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:19.578157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:19.579277 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:19.579277 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:19.579277 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:19.579277 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:19.579277 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:19.579277 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:19.579277 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:19.579277 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:19.579277 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:19.579277 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:19.579277 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:19.579277 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:19.579277 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:19.579277 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:19.579277 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:19.579277 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:19.579277 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:19.579277 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:19.580229 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:19.580229 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:19.580229 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:19.580229 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:19.580229 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:19.580229 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:19.580229 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:19.580229 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:19.580229 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:48:19.580229 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:19.580229 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 307/611] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:48:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:19.580892 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9281a8-cfa8-468b-8ac5-88e6f8b96598 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:19.601276 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef540af-ff7f-4796-9d85-97f189a57ccb None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:19.644491 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6caa48-4b5f-4aa9-8644-becc68d6058e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=V_tFi_-3Qn6UN1eu2EVcZw, audit_chain_id=['V_tFi_-3Qn6UN1eu2EVcZw']) at 0x7f8a0fd42f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:19.645129 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6caa48-4b5f-4aa9-8644-becc68d6058e None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:19.645410 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6caa48-4b5f-4aa9-8644-becc68d6058e None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:19.645712 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6caa48-4b5f-4aa9-8644-becc68d6058e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:19.656132 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6caa48-4b5f-4aa9-8644-becc68d6058e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:19.657596 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6caa48-4b5f-4aa9-8644-becc68d6058e None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:19.673291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-4b6caa48-4b5f-4aa9-8644-becc68d6058e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:19.673291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:19.673291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:19.673291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:19.673291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:19.673291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:19.673291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:19.673291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:19.673291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:19.673291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:19.673291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:19.673291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:19.673291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:19.673291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:19.673291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:19.674419 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:19.674419 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:19.674419 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:19.674419 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:19.674419 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:19.674419 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:19.674419 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:19.674419 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:19.674419 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:19.674419 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:19.674419 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:19.674419 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:19.674419 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:19.674419 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:19.674419 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:19.674419 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:19.674419 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:19.675317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:19.675317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:19.675317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:19.675317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:19.675317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 305/612] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:19.675618 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6caa48-4b5f-4aa9-8644-becc68d6058e None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:19.692401 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9281a8-cfa8-468b-8ac5-88e6f8b96598 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:19.715614 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:19.727113 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:19.731621 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32097e97-a859-4045-ad14-ba36e26e3488 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0epVChhXSkaGf5hIUadhqA, audit_chain_id=['0epVChhXSkaGf5hIUadhqA']) at 0x7f8a0fd1e580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:19.732550 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32097e97-a859-4045-ad14-ba36e26e3488 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:19.732848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32097e97-a859-4045-ad14-ba36e26e3488 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:19.733135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32097e97-a859-4045-ad14-ba36e26e3488 None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:19.733892 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32097e97-a859-4045-ad14-ba36e26e3488 None admin] RBAC: Adding query filter params (name=service) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:19.734205 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32097e97-a859-4045-ad14-ba36e26e3488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:19.736025 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32097e97-a859-4045-ad14-ba36e26e3488 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:19.751315 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 308/613] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 22:48:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:19.751315 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32097e97-a859-4045-ad14-ba36e26e3488 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:19.786164 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6caa48-4b5f-4aa9-8644-becc68d6058e None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:19.820366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa1f51-844e-4804-8da6-e5a1cae5495b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uS4KW1GTTVmx5xU6bPFWUA, audit_chain_id=['uS4KW1GTTVmx5xU6bPFWUA']) at 0x7f8a0fd0c220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:19.820979 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa1f51-844e-4804-8da6-e5a1cae5495b None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:19.821258 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa1f51-844e-4804-8da6-e5a1cae5495b None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:19.821532 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa1f51-844e-4804-8da6-e5a1cae5495b None admin] PATH_INFO: `/v3/users` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:19.822337 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa1f51-844e-4804-8da6-e5a1cae5495b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:19.823212 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa1f51-844e-4804-8da6-e5a1cae5495b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:19.824626 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa1f51-844e-4804-8da6-e5a1cae5495b None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:19.842736 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 306/614] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Jul 25 22:48:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:19.847972 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa1f51-844e-4804-8da6-e5a1cae5495b None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:19.865977 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32097e97-a859-4045-ad14-ba36e26e3488 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:19.903796 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d870d9c-62b6-4ba3-a2d0-1de6b06b1c26 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=V_tFi_-3Qn6UN1eu2EVcZw, audit_chain_id=['V_tFi_-3Qn6UN1eu2EVcZw']) at 0x7f8a0fd40a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:19.904411 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d870d9c-62b6-4ba3-a2d0-1de6b06b1c26 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:19.904689 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d870d9c-62b6-4ba3-a2d0-1de6b06b1c26 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:19.904985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d870d9c-62b6-4ba3-a2d0-1de6b06b1c26 None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:19.905791 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d870d9c-62b6-4ba3-a2d0-1de6b06b1c26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:19.906204 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d870d9c-62b6-4ba3-a2d0-1de6b06b1c26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:19.907546 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d870d9c-62b6-4ba3-a2d0-1de6b06b1c26 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:19.920113 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 309/615] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:19.920902 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d870d9c-62b6-4ba3-a2d0-1de6b06b1c26 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:19.955522 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa1f51-844e-4804-8da6-e5a1cae5495b None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:19.957041 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:19.968968 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:19.991385 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb053684-f0d4-4679-9960-3ace408306ef None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0epVChhXSkaGf5hIUadhqA, audit_chain_id=['0epVChhXSkaGf5hIUadhqA']) at 0x7f8a0fd42cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:19.992375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb053684-f0d4-4679-9960-3ace408306ef None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:19.992675 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb053684-f0d4-4679-9960-3ace408306ef None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:19.992945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb053684-f0d4-4679-9960-3ace408306ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:20.004377 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb053684-f0d4-4679-9960-3ace408306ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:20.005936 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb053684-f0d4-4679-9960-3ace408306ef None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:20.021596 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-bb053684-f0d4-4679-9960-3ace408306ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:20.021596 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:20.021596 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:20.021596 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:20.021596 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:20.021596 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:20.021596 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:20.021596 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:20.021596 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:20.021596 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:20.021596 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:20.021596 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:20.021596 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:20.021596 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:20.021596 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:20.023029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:20.023029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:20.023029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:20.023029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:20.023029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:20.023029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:20.023029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:20.023029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:20.023029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:20.023029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:20.023029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:20.023029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:20.023029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:20.023029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:20.023029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:20.023029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:20.023029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:20.023902 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:20.023902 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:20.023902 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:20.023902 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:20.023902 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 307/616] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:20.023902 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb053684-f0d4-4679-9960-3ace408306ef None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:20.034018 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d870d9c-62b6-4ba3-a2d0-1de6b06b1c26 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:20.070345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286ab09-365c-4f7d-abfc-9d2efe1cce07 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uS4KW1GTTVmx5xU6bPFWUA, audit_chain_id=['uS4KW1GTTVmx5xU6bPFWUA']) at 0x7f8a0fdd9580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:20.071003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286ab09-365c-4f7d-abfc-9d2efe1cce07 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:20.071287 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286ab09-365c-4f7d-abfc-9d2efe1cce07 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:20.071567 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286ab09-365c-4f7d-abfc-9d2efe1cce07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:20.130798 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb053684-f0d4-4679-9960-3ace408306ef None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:20.148014 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286ab09-365c-4f7d-abfc-9d2efe1cce07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:20.149905 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286ab09-365c-4f7d-abfc-9d2efe1cce07 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:20.168095 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d6fad-f4d2-4b67-a6e2-c454baed61d2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=V_tFi_-3Qn6UN1eu2EVcZw, audit_chain_id=['V_tFi_-3Qn6UN1eu2EVcZw']) at 0x7f8a0fd1cd30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:20.168751 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d6fad-f4d2-4b67-a6e2-c454baed61d2 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:20.169031 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d6fad-f4d2-4b67-a6e2-c454baed61d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:20.169313 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d6fad-f4d2-4b67-a6e2-c454baed61d2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:20.177331 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d6fad-f4d2-4b67-a6e2-c454baed61d2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:20.178836 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d6fad-f4d2-4b67-a6e2-c454baed61d2 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:20.191273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-de4d6fad-f4d2-4b67-a6e2-c454baed61d2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:48:20.191273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:20.191273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:20.191273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:20.191273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:20.191273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:20.191273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:20.191273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:20.191273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:20.191273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:20.191273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:20.191273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:20.191273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:20.191273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:20.191273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:20.191273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:20.192284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:20.192284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:20.192284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:20.192284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:20.192284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:20.192284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:20.192284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:20.192284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:20.192284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:20.192284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:20.192284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:20.192284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:20.192284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:20.192284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:20.192284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:20.192284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:20.192284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:20.192284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:20.193427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:20.193427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:20.193427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:20.193427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:20.193427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:20.193427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:20.193427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:20.193427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:20.193427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:48:20.193427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:20.193427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 308/617] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:48:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:20.193427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d6fad-f4d2-4b67-a6e2-c454baed61d2 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:20.206874 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:20.210759 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:20.272704 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 310/618] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:48:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:48:20.273950 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286ab09-365c-4f7d-abfc-9d2efe1cce07 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:20.314157 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d6fad-f4d2-4b67-a6e2-c454baed61d2 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:20.349012 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c79c8-8bd4-4744-a82a-36b30c5ca179 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0epVChhXSkaGf5hIUadhqA, audit_chain_id=['0epVChhXSkaGf5hIUadhqA']) at 0x7f8a0fc83f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:20.349654 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c79c8-8bd4-4744-a82a-36b30c5ca179 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:20.349944 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c79c8-8bd4-4744-a82a-36b30c5ca179 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:20.350219 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c79c8-8bd4-4744-a82a-36b30c5ca179 None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:20.350904 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c79c8-8bd4-4744-a82a-36b30c5ca179 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:20.351209 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c79c8-8bd4-4744-a82a-36b30c5ca179 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:20.353001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c79c8-8bd4-4744-a82a-36b30c5ca179 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:20.366279 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 309/619] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:20.367077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c79c8-8bd4-4744-a82a-36b30c5ca179 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:20.382804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286ab09-365c-4f7d-abfc-9d2efe1cce07 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:20.418975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfbb53-4e49-41d8-bd16-c0ca316a2d13 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=V_tFi_-3Qn6UN1eu2EVcZw, audit_chain_id=['V_tFi_-3Qn6UN1eu2EVcZw']) at 0x7f8a0fdd95e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:20.419598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfbb53-4e49-41d8-bd16-c0ca316a2d13 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:20.419883 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfbb53-4e49-41d8-bd16-c0ca316a2d13 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:20.420158 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfbb53-4e49-41d8-bd16-c0ca316a2d13 None admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:20.420933 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfbb53-4e49-41d8-bd16-c0ca316a2d13 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:20.421238 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfbb53-4e49-41d8-bd16-c0ca316a2d13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:20.422693 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfbb53-4e49-41d8-bd16-c0ca316a2d13 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:20.443340 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 311/620] 10.222.0.47 () {56 vars in 1137 bytes} [Mon Jul 25 22:48:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:20.444428 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfbb53-4e49-41d8-bd16-c0ca316a2d13 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:20.449891 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:20.459380 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:20.488512 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c79c8-8bd4-4744-a82a-36b30c5ca179 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:20.527206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cf812-c398-4153-bfd8-156dde2b3bbc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uS4KW1GTTVmx5xU6bPFWUA, audit_chain_id=['uS4KW1GTTVmx5xU6bPFWUA']) at 0x7f8a0fc83fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:20.527860 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cf812-c398-4153-bfd8-156dde2b3bbc None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:20.528143 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cf812-c398-4153-bfd8-156dde2b3bbc None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:20.528423 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cf812-c398-4153-bfd8-156dde2b3bbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:20.538978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cf812-c398-4153-bfd8-156dde2b3bbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:20.540457 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cf812-c398-4153-bfd8-156dde2b3bbc None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:20.556198 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-d97cf812-c398-4153-bfd8-156dde2b3bbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:20.556198 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:20.556198 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:20.556198 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:20.556198 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:20.556198 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:20.556198 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:20.556198 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:20.556198 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:20.556198 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:20.556198 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:20.556198 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:20.556198 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:20.556198 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:20.556198 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:20.557807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:20.557807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:20.557807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:20.557807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:20.557807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:20.557807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:20.557807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:20.557807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:20.557807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:20.557807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:20.557807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:20.557807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:20.557807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:20.557807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:20.557807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:20.557807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:20.557807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:20.558859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:20.558859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:20.558859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:20.558859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:20.558859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 310/621] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:20.563504 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cf812-c398-4153-bfd8-156dde2b3bbc None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:20.575660 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfbb53-4e49-41d8-bd16-c0ca316a2d13 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:20.612173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb3d24-dda9-4abf-90ed-e780bf1c647a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0epVChhXSkaGf5hIUadhqA, audit_chain_id=['0epVChhXSkaGf5hIUadhqA']) at 0x7f8a0fccb6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:20.612821 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3d24-dda9-4abf-90ed-e780bf1c647a None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:20.613107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3d24-dda9-4abf-90ed-e780bf1c647a None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:20.613389 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb3d24-dda9-4abf-90ed-e780bf1c647a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:20.620910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb3d24-dda9-4abf-90ed-e780bf1c647a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:20.622376 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb3d24-dda9-4abf-90ed-e780bf1c647a None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:20.634231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-2bfb3d24-dda9-4abf-90ed-e780bf1c647a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:48:20.634231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:20.634231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:20.634231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:20.634231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:20.634231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:20.634231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:20.634231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:20.634231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:20.634231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:20.634231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:20.634231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:20.634231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:20.634231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:20.634231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:20.634231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:20.635495 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:20.635495 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:20.635495 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:20.635495 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:20.635495 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:20.635495 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:20.635495 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:20.635495 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:20.635495 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:20.635495 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:20.635495 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:20.635495 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:20.635495 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:20.635495 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:20.635495 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:20.635495 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:20.635495 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:20.635495 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:20.636830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:20.636830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:20.636830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:20.636830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:20.636830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:20.636830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:20.636830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:20.636830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:20.636830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:48:20.636830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:20.639964 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 312/622] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 22:48:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:20.640927 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb3d24-dda9-4abf-90ed-e780bf1c647a None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:20.674303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cf812-c398-4153-bfd8-156dde2b3bbc None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:20.700951 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:20.704300 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:20.711535 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d827e7b-bd68-47dd-9285-a6846a14f93d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=V_tFi_-3Qn6UN1eu2EVcZw, audit_chain_id=['V_tFi_-3Qn6UN1eu2EVcZw']) at 0x7f8a0fd2eee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:20.712286 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d827e7b-bd68-47dd-9285-a6846a14f93d None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:20.712568 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d827e7b-bd68-47dd-9285-a6846a14f93d None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:20.712844 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d827e7b-bd68-47dd-9285-a6846a14f93d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:20.747246 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb3d24-dda9-4abf-90ed-e780bf1c647a None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:20.783456 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e8b45-4fb6-4b90-b633-ccf1fb61f758 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uS4KW1GTTVmx5xU6bPFWUA, audit_chain_id=['uS4KW1GTTVmx5xU6bPFWUA']) at 0x7f8a0fd64fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:20.783809 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d827e7b-bd68-47dd-9285-a6846a14f93d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:20.784083 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e8b45-4fb6-4b90-b633-ccf1fb61f758 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:20.784368 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e8b45-4fb6-4b90-b633-ccf1fb61f758 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:20.784648 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e8b45-4fb6-4b90-b633-ccf1fb61f758 None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:20.785234 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d827e7b-bd68-47dd-9285-a6846a14f93d None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:20.785342 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e8b45-4fb6-4b90-b633-ccf1fb61f758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:20.785658 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e8b45-4fb6-4b90-b633-ccf1fb61f758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:20.787025 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e8b45-4fb6-4b90-b633-ccf1fb61f758 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:20.804526 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 313/623] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:20.804526 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e8b45-4fb6-4b90-b633-ccf1fb61f758 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:20.899935 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 311/624] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:48:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:48:20.899935 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d827e7b-bd68-47dd-9285-a6846a14f93d None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:20.934244 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:20.934795 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e8b45-4fb6-4b90-b633-ccf1fb61f758 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:20.959443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:20.974772 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201bdf0-2dde-4e68-84cb-6334cfea687a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0epVChhXSkaGf5hIUadhqA, audit_chain_id=['0epVChhXSkaGf5hIUadhqA']) at 0x7f8a0fd5fca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:20.975478 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201bdf0-2dde-4e68-84cb-6334cfea687a None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:20.975838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201bdf0-2dde-4e68-84cb-6334cfea687a None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:20.976183 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201bdf0-2dde-4e68-84cb-6334cfea687a None admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:20.977051 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201bdf0-2dde-4e68-84cb-6334cfea687a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:20.977430 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201bdf0-2dde-4e68-84cb-6334cfea687a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:20.979210 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201bdf0-2dde-4e68-84cb-6334cfea687a None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:20.999168 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 314/625] 10.222.0.47 () {56 vars in 1139 bytes} [Mon Jul 25 22:48:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:21.004603 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201bdf0-2dde-4e68-84cb-6334cfea687a None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:21.017650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d827e7b-bd68-47dd-9285-a6846a14f93d None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:21.053468 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cbe41-47ff-48e0-92c3-27da0663cb86 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uS4KW1GTTVmx5xU6bPFWUA, audit_chain_id=['uS4KW1GTTVmx5xU6bPFWUA']) at 0x7f8a0fc835b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:21.054163 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cbe41-47ff-48e0-92c3-27da0663cb86 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:21.054411 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cbe41-47ff-48e0-92c3-27da0663cb86 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:21.054691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cbe41-47ff-48e0-92c3-27da0663cb86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:21.061780 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cbe41-47ff-48e0-92c3-27da0663cb86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:21.063245 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cbe41-47ff-48e0-92c3-27da0663cb86 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:21.075949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-d70cbe41-47ff-48e0-92c3-27da0663cb86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:21.075949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:21.075949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:21.075949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:21.075949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:21.075949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:21.075949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:21.075949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:21.075949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:21.075949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:21.075949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:21.075949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:21.075949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:21.075949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:21.075949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:21.076920 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:21.076920 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:21.076920 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:21.076920 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:21.076920 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:21.076920 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:21.076920 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:21.076920 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:21.076920 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:21.076920 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:21.076920 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:21.076920 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:21.076920 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:21.076920 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:21.076920 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:21.076920 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:21.076920 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:21.077859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:21.077859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:21.077859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:21.077859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:21.077859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:21.077859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:21.077859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:21.077859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:21.077859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 312/626] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:21.078356 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cbe41-47ff-48e0-92c3-27da0663cb86 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:21.125152 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201bdf0-2dde-4e68-84cb-6334cfea687a None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:21.166918 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863ef47-8409-4275-9471-eafad4133fa5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=V_tFi_-3Qn6UN1eu2EVcZw, audit_chain_id=['V_tFi_-3Qn6UN1eu2EVcZw']) at 0x7f8a0fdd0820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:21.168015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863ef47-8409-4275-9471-eafad4133fa5 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:21.168471 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863ef47-8409-4275-9471-eafad4133fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:21.168816 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863ef47-8409-4275-9471-eafad4133fa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:21.175009 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:21.181010 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863ef47-8409-4275-9471-eafad4133fa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:21.182666 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863ef47-8409-4275-9471-eafad4133fa5 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:21.194219 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cbe41-47ff-48e0-92c3-27da0663cb86 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:21.200241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-5863ef47-8409-4275-9471-eafad4133fa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:21.200241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:21.200241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:21.200241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:21.200241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:21.200241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:21.200241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:21.200241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:21.200241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:21.200241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:21.200241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:21.200241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:21.200241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:21.200241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:21.200241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:21.201139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:21.201139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:21.201139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:21.201139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:21.201139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:21.201139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:21.201139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:21.201139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:21.201139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:21.201139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:21.201139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:21.201139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:21.201139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:21.201139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:21.201139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:21.201139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:21.201139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:21.206889 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:21.206889 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:21.206889 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:21.206889 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:21.206889 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 315/627] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:21.206889 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863ef47-8409-4275-9471-eafad4133fa5 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:21.238054 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b39700-25a1-44c9-b4b9-f362a3c776d4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0epVChhXSkaGf5hIUadhqA, audit_chain_id=['0epVChhXSkaGf5hIUadhqA']) at 0x7f8a0fc9af40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:21.238774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b39700-25a1-44c9-b4b9-f362a3c776d4 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:21.239056 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b39700-25a1-44c9-b4b9-f362a3c776d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:21.239244 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:21.239342 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b39700-25a1-44c9-b4b9-f362a3c776d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:21.308542 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863ef47-8409-4275-9471-eafad4133fa5 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:21.309640 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b39700-25a1-44c9-b4b9-f362a3c776d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:21.311129 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b39700-25a1-44c9-b4b9-f362a3c776d4 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:21.342650 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bbd1a-8093-4950-ac72-056581956565 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uS4KW1GTTVmx5xU6bPFWUA, audit_chain_id=['uS4KW1GTTVmx5xU6bPFWUA']) at 0x7f8a0fd5fd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:21.343260 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bbd1a-8093-4950-ac72-056581956565 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:21.343540 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bbd1a-8093-4950-ac72-056581956565 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:21.343813 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bbd1a-8093-4950-ac72-056581956565 None admin] PATH_INFO: `/v3/projects` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:21.344545 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bbd1a-8093-4950-ac72-056581956565 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:21.344850 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bbd1a-8093-4950-ac72-056581956565 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:21.346308 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bbd1a-8093-4950-ac72-056581956565 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:21.358504 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 316/628] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:21.359285 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bbd1a-8093-4950-ac72-056581956565 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:21.399181 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:21.415230 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 313/629] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:48:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:48:21.416518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f384e-e9dd-4986-a3fa-8df7c5d32c73 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:21.416805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f384e-e9dd-4986-a3fa-8df7c5d32c73 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:21.417167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f384e-e9dd-4986-a3fa-8df7c5d32c73 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:21.418480 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 314/630] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:21.419043 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f384e-e9dd-4986-a3fa-8df7c5d32c73 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:21.458877 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:21.468814 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bbd1a-8093-4950-ac72-056581956565 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:21.504058 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6dfa2-5145-41a9-bf4f-543e4d4e85c8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=V_tFi_-3Qn6UN1eu2EVcZw, audit_chain_id=['V_tFi_-3Qn6UN1eu2EVcZw']) at 0x7f8a0fd2f280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:21.504834 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6dfa2-5145-41a9-bf4f-543e4d4e85c8 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:21.505121 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6dfa2-5145-41a9-bf4f-543e4d4e85c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:21.505401 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6dfa2-5145-41a9-bf4f-543e4d4e85c8 None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:21.506129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6dfa2-5145-41a9-bf4f-543e4d4e85c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:21.506618 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6dfa2-5145-41a9-bf4f-543e4d4e85c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:21.507791 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6dfa2-5145-41a9-bf4f-543e4d4e85c8 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:21.520301 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 317/631] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:21.521158 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6dfa2-5145-41a9-bf4f-543e4d4e85c8 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:21.523903 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f384e-e9dd-4986-a3fa-8df7c5d32c73 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:21.558861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1570e-8800-45e5-bc9f-a9a548a5f05d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uS4KW1GTTVmx5xU6bPFWUA, audit_chain_id=['uS4KW1GTTVmx5xU6bPFWUA']) at 0x7f8a0fe13670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:21.559479 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1570e-8800-45e5-bc9f-a9a548a5f05d None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:21.559766 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1570e-8800-45e5-bc9f-a9a548a5f05d None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:21.560041 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1570e-8800-45e5-bc9f-a9a548a5f05d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:21.560824 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1570e-8800-45e5-bc9f-a9a548a5f05d None admin] RBAC: Adding query filter params (role.id=b50669f613ba46d78e9cb6c7e420b140, scope.project.id=2d1b44363d694c60867ec29af4f9d01e, user.id=bea7c9ce1d3c4fe983e5944e5f92ff91) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:21.561135 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1570e-8800-45e5-bc9f-a9a548a5f05d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:21.562641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1570e-8800-45e5-bc9f-a9a548a5f05d None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:21.568345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 315/632] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:48:21 2022] GET /identity/v3/role_assignments?user.id=bea7c9ce1d3c4fe983e5944e5f92ff91&scope.project.id=2d1b44363d694c60867ec29af4f9d01e&role.id=b50669f613ba46d78e9cb6c7e420b140 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:21.569491 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d3922-715c-4c55-aa08-45b5bd92a8fe None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:21.569826 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d3922-715c-4c55-aa08-45b5bd92a8fe None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:21.570104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d3922-715c-4c55-aa08-45b5bd92a8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:21.591556 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-6e0d3922-715c-4c55-aa08-45b5bd92a8fe None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:21.592803 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-6e0d3922-715c-4c55-aa08-45b5bd92a8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:21.630256 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6dfa2-5145-41a9-bf4f-543e4d4e85c8 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:21.652164 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:21.671546 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5840e7-b9bf-44d8-97ed-f01ff1aa173e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0epVChhXSkaGf5hIUadhqA, audit_chain_id=['0epVChhXSkaGf5hIUadhqA']) at 0x7f8a0fd2fa90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:21.672126 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5840e7-b9bf-44d8-97ed-f01ff1aa173e None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:21.672413 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5840e7-b9bf-44d8-97ed-f01ff1aa173e None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:21.672678 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5840e7-b9bf-44d8-97ed-f01ff1aa173e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:21.675889 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 316/633] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:48:21.676829 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d3922-715c-4c55-aa08-45b5bd92a8fe None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:21.699244 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5840e7-b9bf-44d8-97ed-f01ff1aa173e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:21.700994 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5840e7-b9bf-44d8-97ed-f01ff1aa173e None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:21.718355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-1b5840e7-b9bf-44d8-97ed-f01ff1aa173e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:21.718355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:21.718355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:21.718355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:21.718355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:21.718355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:21.718355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:21.718355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:21.718355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:21.718355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:21.718355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:21.718355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:21.718355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:21.718355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:21.718355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:21.719519 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:21.719519 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:21.719519 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:21.719519 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:21.719519 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:21.719519 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:21.719519 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:21.719519 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:21.719519 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:21.719519 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:21.719519 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:21.719519 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:21.719519 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:21.719519 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:21.719519 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:21.719519 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:21.719519 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:21.726069 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:21.726069 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:21.726069 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:21.726069 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:21.726069 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 318/634] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:21.726069 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5840e7-b9bf-44d8-97ed-f01ff1aa173e None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:21.727935 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:21.794460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d3922-715c-4c55-aa08-45b5bd92a8fe None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:21.835986 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ad72c-35b6-478f-8003-2390ddfd354f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=V_tFi_-3Qn6UN1eu2EVcZw, audit_chain_id=['V_tFi_-3Qn6UN1eu2EVcZw']) at 0x7f8a0fe088e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:21.836631 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ad72c-35b6-478f-8003-2390ddfd354f None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:21.836918 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ad72c-35b6-478f-8003-2390ddfd354f None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:21.837260 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ad72c-35b6-478f-8003-2390ddfd354f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:21.844704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ad72c-35b6-478f-8003-2390ddfd354f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:21.846040 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5840e7-b9bf-44d8-97ed-f01ff1aa173e None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:21.846229 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4ad72c-35b6-478f-8003-2390ddfd354f None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:21.859098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-6d4ad72c-35b6-478f-8003-2390ddfd354f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:21.859098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:21.859098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:21.859098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:21.859098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:21.859098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:21.859098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:21.859098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:21.859098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:21.859098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:21.859098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:21.859098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:21.859098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:21.859098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:21.859098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:21.860016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:21.860016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:21.860016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:21.860016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:21.860016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:21.860016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:21.860016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:21.860016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:21.860016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:21.860016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:21.860016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:21.860016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:21.860016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:21.860016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:21.860016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:21.860016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:21.860016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:21.860901 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:21.860901 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:21.860901 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:21.860901 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:21.860901 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:21.860901 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:21.860901 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:21.860901 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:21.860901 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 317/635] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:21.861411 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ad72c-35b6-478f-8003-2390ddfd354f None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:21.887670 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fdcb3-0618-407b-9030-ee2cba8b7e13 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xOxDz7GiTayhtRDpkq1XVw, audit_chain_id=['xOxDz7GiTayhtRDpkq1XVw']) at 0x7f8a0fd82190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:21.888329 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fdcb3-0618-407b-9030-ee2cba8b7e13 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:21.888598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fdcb3-0618-407b-9030-ee2cba8b7e13 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:21.888878 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fdcb3-0618-407b-9030-ee2cba8b7e13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:21.901638 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fdcb3-0618-407b-9030-ee2cba8b7e13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:21.907061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:21.907808 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-a58fdcb3-0618-407b-9030-ee2cba8b7e13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:48:21.907808 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:21.907808 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:21.907808 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:21.907808 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:21.907808 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:21.907808 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:21.907808 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:21.907808 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:21.907808 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:21.907808 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:21.907808 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:21.907808 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:21.907808 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:21.907808 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:21.907808 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:21.908715 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:21.908715 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:21.908715 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:21.908715 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:21.908715 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:21.908715 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:21.908715 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:21.908715 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:21.908715 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:21.908715 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:21.908715 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:21.908715 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:21.908715 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:21.908715 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:21.908715 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:21.908715 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:21.909550 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:21.909550 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:21.909550 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:21.909550 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:21.909550 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:21.909550 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:21.909550 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:21.909550 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:21.909550 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:21.909550 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:21.909550 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:48:21.909550 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:21.910240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 319/636] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 22:48:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:21.910919 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fdcb3-0618-407b-9030-ee2cba8b7e13 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:21.980707 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:21.982314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4ad72c-35b6-478f-8003-2390ddfd354f None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:22.020991 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09f33d-112c-49ef-9a09-1f9f581b95f3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0epVChhXSkaGf5hIUadhqA, audit_chain_id=['0epVChhXSkaGf5hIUadhqA']) at 0x7f8a0fd88bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:22.021692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09f33d-112c-49ef-9a09-1f9f581b95f3 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:22.021978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09f33d-112c-49ef-9a09-1f9f581b95f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:22.022245 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fdcb3-0618-407b-9030-ee2cba8b7e13 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:22.022351 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f09f33d-112c-49ef-9a09-1f9f581b95f3 None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:22.022929 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09f33d-112c-49ef-9a09-1f9f581b95f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:22.023229 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09f33d-112c-49ef-9a09-1f9f581b95f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:22.025148 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f09f33d-112c-49ef-9a09-1f9f581b95f3 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:22.043077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 318/637] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:22.043077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09f33d-112c-49ef-9a09-1f9f581b95f3 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:22.064217 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c72519-caf1-4843-ba7d-0f677ce9b65e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=V_tFi_-3Qn6UN1eu2EVcZw, audit_chain_id=['V_tFi_-3Qn6UN1eu2EVcZw']) at 0x7f8a0fdc3c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:22.064869 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c72519-caf1-4843-ba7d-0f677ce9b65e None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:22.065127 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c72519-caf1-4843-ba7d-0f677ce9b65e None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:22.065400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c72519-caf1-4843-ba7d-0f677ce9b65e None admin] PATH_INFO: `/v3/projects` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:22.066191 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c72519-caf1-4843-ba7d-0f677ce9b65e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:22.066507 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c72519-caf1-4843-ba7d-0f677ce9b65e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:22.067919 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c72519-caf1-4843-ba7d-0f677ce9b65e None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:22.080444 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 320/638] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:22.081252 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c72519-caf1-4843-ba7d-0f677ce9b65e None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:22.157742 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:22.161979 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f09f33d-112c-49ef-9a09-1f9f581b95f3 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:22.190343 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c72519-caf1-4843-ba7d-0f677ce9b65e None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:22.199104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1f6a7-c51d-412b-8478-46651e060f6d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xOxDz7GiTayhtRDpkq1XVw, audit_chain_id=['xOxDz7GiTayhtRDpkq1XVw']) at 0x7f8a0fd70f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:22.199784 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f6a7-c51d-412b-8478-46651e060f6d None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:22.200062 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f6a7-c51d-412b-8478-46651e060f6d None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:22.200340 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f6a7-c51d-412b-8478-46651e060f6d None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:22.201058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1f6a7-c51d-412b-8478-46651e060f6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:22.201362 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1f6a7-c51d-412b-8478-46651e060f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:22.202784 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1f6a7-c51d-412b-8478-46651e060f6d None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:22.216358 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:22.216526 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 319/639] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:48:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:22.217937 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1f6a7-c51d-412b-8478-46651e060f6d None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:22.230702 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c538d6-f59e-40a3-b406-ab497d73e0bd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0epVChhXSkaGf5hIUadhqA, audit_chain_id=['0epVChhXSkaGf5hIUadhqA']) at 0x7f8a0fdcd7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:22.231412 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c538d6-f59e-40a3-b406-ab497d73e0bd None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:22.231638 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c538d6-f59e-40a3-b406-ab497d73e0bd None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:22.232216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c538d6-f59e-40a3-b406-ab497d73e0bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:22.239945 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c538d6-f59e-40a3-b406-ab497d73e0bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:22.241383 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c538d6-f59e-40a3-b406-ab497d73e0bd None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:22.253630 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-16c538d6-f59e-40a3-b406-ab497d73e0bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:22.253630 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:22.253630 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:22.253630 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:22.253630 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:22.253630 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:22.253630 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:22.253630 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:22.253630 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:22.253630 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:22.253630 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:22.253630 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:22.253630 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:22.253630 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:22.253630 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:22.254691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:22.254691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:22.254691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:22.254691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:22.254691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:22.254691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:22.254691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:22.254691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:22.254691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:22.254691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:22.254691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:22.254691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:22.254691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:22.254691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:22.254691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:22.254691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:22.254691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:22.255662 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:22.255662 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:22.255662 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:22.255662 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:22.255662 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:22.255662 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:22.255662 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:22.255662 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:22.255662 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 321/640] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:22.255662 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c538d6-f59e-40a3-b406-ab497d73e0bd None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:22.332160 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1f6a7-c51d-412b-8478-46651e060f6d None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:22.365981 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c538d6-f59e-40a3-b406-ab497d73e0bd None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:22.367803 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b3d63-4396-49dc-ab5a-3742d547a017 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=V_tFi_-3Qn6UN1eu2EVcZw, audit_chain_id=['V_tFi_-3Qn6UN1eu2EVcZw']) at 0x7f8a0fe46eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:22.368432 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b3d63-4396-49dc-ab5a-3742d547a017 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:22.368712 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b3d63-4396-49dc-ab5a-3742d547a017 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:22.368989 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b3d63-4396-49dc-ab5a-3742d547a017 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:22.370439 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b3d63-4396-49dc-ab5a-3742d547a017 None admin] RBAC: Adding query filter params (role.id=b50669f613ba46d78e9cb6c7e420b140, scope.project.id=2d1b44363d694c60867ec29af4f9d01e, user.id=cc1a058881084fbdbf53096109e5381f) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:22.370748 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b3d63-4396-49dc-ab5a-3742d547a017 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:22.372181 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b3d63-4396-49dc-ab5a-3742d547a017 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:22.378760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 320/641] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:48:22 2022] GET /identity/v3/role_assignments?user.id=cc1a058881084fbdbf53096109e5381f&scope.project.id=2d1b44363d694c60867ec29af4f9d01e&role.id=b50669f613ba46d78e9cb6c7e420b140 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:22.379634 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b3d63-4396-49dc-ab5a-3742d547a017 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:22.416482 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4574de-6bfd-4bf0-aff4-4b0dc517bdb5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xOxDz7GiTayhtRDpkq1XVw, audit_chain_id=['xOxDz7GiTayhtRDpkq1XVw']) at 0x7f8a0fcd8a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:22.417512 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4574de-6bfd-4bf0-aff4-4b0dc517bdb5 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:22.418033 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4574de-6bfd-4bf0-aff4-4b0dc517bdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:22.418719 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:22.419178 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4574de-6bfd-4bf0-aff4-4b0dc517bdb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:22.433278 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4574de-6bfd-4bf0-aff4-4b0dc517bdb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:22.435215 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4574de-6bfd-4bf0-aff4-4b0dc517bdb5 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:22.452399 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-6b4574de-6bfd-4bf0-aff4-4b0dc517bdb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:22.452399 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:22.452399 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:22.452399 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:22.452399 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:22.452399 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:22.452399 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:22.452399 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:22.452399 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:22.452399 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:22.452399 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:22.452399 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:22.452399 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:22.452399 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:22.452399 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:22.453570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:22.453570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:22.453570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:22.453570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:22.453570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:22.453570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:22.453570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:22.453570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:22.453570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:22.453570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:22.453570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:22.453570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:22.453570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:22.453570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:22.453570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:22.453570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:22.453570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:22.454701 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:22.454701 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:22.454701 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:22.454701 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:22.456299 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 322/642] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:22.462132 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4574de-6bfd-4bf0-aff4-4b0dc517bdb5 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:22.510752 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:22.520797 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b3d63-4396-49dc-ab5a-3742d547a017 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:22.568571 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9033a1-870a-4a5e-b5c4-61e9560a04fc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0epVChhXSkaGf5hIUadhqA, audit_chain_id=['0epVChhXSkaGf5hIUadhqA']) at 0x7f8a0fe18dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:22.569516 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9033a1-870a-4a5e-b5c4-61e9560a04fc None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:22.569991 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9033a1-870a-4a5e-b5c4-61e9560a04fc None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:22.570475 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9033a1-870a-4a5e-b5c4-61e9560a04fc None admin] PATH_INFO: `/v3/projects` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:22.571548 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9033a1-870a-4a5e-b5c4-61e9560a04fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:22.572108 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9033a1-870a-4a5e-b5c4-61e9560a04fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:22.574294 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9033a1-870a-4a5e-b5c4-61e9560a04fc None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:22.588440 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4574de-6bfd-4bf0-aff4-4b0dc517bdb5 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:22.589663 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 321/643] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:22.595874 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9033a1-870a-4a5e-b5c4-61e9560a04fc None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:22.631327 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1a753-4169-4662-affa-4212becdb080 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xOxDz7GiTayhtRDpkq1XVw, audit_chain_id=['xOxDz7GiTayhtRDpkq1XVw']) at 0x7f8a0fd1ecd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:22.632331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1a753-4169-4662-affa-4212becdb080 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:22.632331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1a753-4169-4662-affa-4212becdb080 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:22.632520 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1a753-4169-4662-affa-4212becdb080 None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:22.633183 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1a753-4169-4662-affa-4212becdb080 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:22.633476 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1a753-4169-4662-affa-4212becdb080 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:22.635910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1a753-4169-4662-affa-4212becdb080 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:22.655393 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 323/644] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:22.660571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1a753-4169-4662-affa-4212becdb080 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:22.713947 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:22.730980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9033a1-870a-4a5e-b5c4-61e9560a04fc None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:22.765293 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:22.771131 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7fca2-c68e-4173-a3c9-53cce9b62f55 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0epVChhXSkaGf5hIUadhqA, audit_chain_id=['0epVChhXSkaGf5hIUadhqA']) at 0x7f8a0fe0ceb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:22.771753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1a753-4169-4662-affa-4212becdb080 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:22.772437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7fca2-c68e-4173-a3c9-53cce9b62f55 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:22.772874 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7fca2-c68e-4173-a3c9-53cce9b62f55 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:22.773327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7fca2-c68e-4173-a3c9-53cce9b62f55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:22.774814 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7fca2-c68e-4173-a3c9-53cce9b62f55 None admin] RBAC: Adding query filter params (role.id=b50669f613ba46d78e9cb6c7e420b140, scope.project.id=2d1b44363d694c60867ec29af4f9d01e, user.id=f77ef50984084af9bcd220fc68deacf8) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:22.775437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7fca2-c68e-4173-a3c9-53cce9b62f55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:22.777360 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7fca2-c68e-4173-a3c9-53cce9b62f55 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:22.784923 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 322/645] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:48:22 2022] GET /identity/v3/role_assignments?user.id=f77ef50984084af9bcd220fc68deacf8&scope.project.id=2d1b44363d694c60867ec29af4f9d01e&role.id=b50669f613ba46d78e9cb6c7e420b140 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:22.814114 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda7f75-ca39-494f-8aa5-7d710e12b25d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xOxDz7GiTayhtRDpkq1XVw, audit_chain_id=['xOxDz7GiTayhtRDpkq1XVw']) at 0x7f8a0fd1ea60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:22.814896 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda7f75-ca39-494f-8aa5-7d710e12b25d None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:22.815255 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda7f75-ca39-494f-8aa5-7d710e12b25d None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:22.815600 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda7f75-ca39-494f-8aa5-7d710e12b25d None admin] PATH_INFO: `/v3/users/nova` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:22.824387 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda7f75-ca39-494f-8aa5-7d710e12b25d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:22.826003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda7f75-ca39-494f-8aa5-7d710e12b25d None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:22.840177 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-7bda7f75-ca39-494f-8aa5-7d710e12b25d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:48:22.840177 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:22.840177 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:22.840177 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:22.840177 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:22.840177 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:22.840177 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:22.840177 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:22.840177 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:22.840177 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:22.840177 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:22.840177 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:22.840177 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:22.840177 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:22.840177 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:22.840177 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:22.841400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:22.841400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:22.841400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:22.841400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:22.841400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:22.841400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:22.841400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:22.841400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:22.841400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:22.841400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:22.841400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:22.841400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:22.841400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:22.841400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:22.841400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:22.841400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:22.841400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:22.841400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:22.842642 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:22.842642 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:22.842642 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:22.842642 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:22.842642 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:22.842642 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:22.842642 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:22.842642 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:22.842642 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:48:22.842642 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:22.844700 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 324/646] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Jul 25 22:48:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:48:22.849506 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7fca2-c68e-4173-a3c9-53cce9b62f55 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:22.973117 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7fca2-c68e-4173-a3c9-53cce9b62f55 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:23.012510 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66274bf9-0d52-4481-942d-6db41bda6b37 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xOxDz7GiTayhtRDpkq1XVw, audit_chain_id=['xOxDz7GiTayhtRDpkq1XVw']) at 0x7f8a0fe08850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:23.013237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66274bf9-0d52-4481-942d-6db41bda6b37 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:23.013524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66274bf9-0d52-4481-942d-6db41bda6b37 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:23.013881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66274bf9-0d52-4481-942d-6db41bda6b37 None admin] PATH_INFO: `/v3/users` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:23.014680 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66274bf9-0d52-4481-942d-6db41bda6b37 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:23.015240 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66274bf9-0d52-4481-942d-6db41bda6b37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:23.016752 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66274bf9-0d52-4481-942d-6db41bda6b37 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:23.035980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 323/647] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Jul 25 22:48:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:23.041697 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda7f75-ca39-494f-8aa5-7d710e12b25d None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:23.148815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda7f75-ca39-494f-8aa5-7d710e12b25d None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:23.184173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5719e8d-bdd3-4098-8313-a19180239627 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xOxDz7GiTayhtRDpkq1XVw, audit_chain_id=['xOxDz7GiTayhtRDpkq1XVw']) at 0x7f8a0fdc2880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:23.184953 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5719e8d-bdd3-4098-8313-a19180239627 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:23.185315 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5719e8d-bdd3-4098-8313-a19180239627 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:23.185694 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5719e8d-bdd3-4098-8313-a19180239627 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:23.215590 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:23.268660 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5719e8d-bdd3-4098-8313-a19180239627 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:23.270065 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5719e8d-bdd3-4098-8313-a19180239627 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:23.372533 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 325/648] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:48:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:48:23.378123 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66274bf9-0d52-4481-942d-6db41bda6b37 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:23.389301 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:23.491912 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66274bf9-0d52-4481-942d-6db41bda6b37 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:23.528978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dae06b-3fb4-4e02-8921-ff7d51c5403b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xOxDz7GiTayhtRDpkq1XVw, audit_chain_id=['xOxDz7GiTayhtRDpkq1XVw']) at 0x7f8a0fe25b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:23.529717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dae06b-3fb4-4e02-8921-ff7d51c5403b None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:23.530077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dae06b-3fb4-4e02-8921-ff7d51c5403b None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:23.530418 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dae06b-3fb4-4e02-8921-ff7d51c5403b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:23.546384 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dae06b-3fb4-4e02-8921-ff7d51c5403b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:23.548004 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dae06b-3fb4-4e02-8921-ff7d51c5403b None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:23.563992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-77dae06b-3fb4-4e02-8921-ff7d51c5403b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:23.563992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:23.563992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:23.563992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:23.563992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:23.563992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:23.563992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:23.563992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:23.563992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:23.563992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:23.563992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:23.563992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:23.563992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:23.563992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:23.563992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:23.565756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:23.565756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:23.565756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:23.565756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:23.565756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:23.565756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:23.565756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:23.565756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:23.565756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:23.565756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:23.565756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:23.565756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:23.565756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:23.565756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:23.565756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:23.565756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:23.565756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:23.567865 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:23.567865 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:23.567865 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:23.567865 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:23.567865 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 324/649] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:23.574643 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5719e8d-bdd3-4098-8313-a19180239627 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:23.634761 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:23.678908 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5719e8d-bdd3-4098-8313-a19180239627 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:23.721284 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfc20c-99f9-4edd-9f6c-d1ecb3a744b9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xOxDz7GiTayhtRDpkq1XVw, audit_chain_id=['xOxDz7GiTayhtRDpkq1XVw']) at 0x7f8a0fd2fee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:23.721943 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfc20c-99f9-4edd-9f6c-d1ecb3a744b9 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:23.722225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfc20c-99f9-4edd-9f6c-d1ecb3a744b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:23.722500 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfc20c-99f9-4edd-9f6c-d1ecb3a744b9 None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:23.723196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dfc20c-99f9-4edd-9f6c-d1ecb3a744b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:23.723500 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dfc20c-99f9-4edd-9f6c-d1ecb3a744b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:23.724876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dfc20c-99f9-4edd-9f6c-d1ecb3a744b9 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:23.741744 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 326/650] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:23.743167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dae06b-3fb4-4e02-8921-ff7d51c5403b None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:23.808895 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:23.860743 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dae06b-3fb4-4e02-8921-ff7d51c5403b None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:23.894613 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf6e30-9b97-476b-a6c0-12fdbe37ae92 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xOxDz7GiTayhtRDpkq1XVw, audit_chain_id=['xOxDz7GiTayhtRDpkq1XVw']) at 0x7f8a0fd6f760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:23.895267 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf6e30-9b97-476b-a6c0-12fdbe37ae92 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:23.895552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf6e30-9b97-476b-a6c0-12fdbe37ae92 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:23.895829 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf6e30-9b97-476b-a6c0-12fdbe37ae92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:23.903427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf6e30-9b97-476b-a6c0-12fdbe37ae92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:23.904877 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf6e30-9b97-476b-a6c0-12fdbe37ae92 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:23.917309 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-1adf6e30-9b97-476b-a6c0-12fdbe37ae92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:23.917309 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:23.917309 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:23.917309 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:23.917309 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:23.917309 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:23.917309 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:23.917309 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:23.917309 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:23.917309 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:23.917309 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:23.917309 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:23.917309 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:23.917309 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:23.917309 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:23.919206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:23.919206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:23.919206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:23.919206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:23.919206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:23.919206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:23.919206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:23.919206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:23.919206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:23.919206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:23.919206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:23.919206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:23.919206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:23.919206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:23.919206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:23.919206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:23.919206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:23.920464 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:23.920464 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:23.920464 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:23.920464 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:23.920464 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:23.920464 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:23.920464 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:23.920464 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:23.920464 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 325/651] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:23.924462 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfc20c-99f9-4edd-9f6c-d1ecb3a744b9 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:23.990952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739eee6-ce98-436a-8140-4eec595096aa None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:23.991256 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739eee6-ce98-436a-8140-4eec595096aa None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:23.991510 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739eee6-ce98-436a-8140-4eec595096aa None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:23.993160 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 326/652] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:48:23.999054 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfa98e-f532-4a2c-a1a5-b6fc6ddc7ea5 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:23.999487 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfa98e-f532-4a2c-a1a5-b6fc6ddc7ea5 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:23.999865 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfa98e-f532-4a2c-a1a5-b6fc6ddc7ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:24.020703 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-4dbfa98e-f532-4a2c-a1a5-b6fc6ddc7ea5 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:24.022092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-4dbfa98e-f532-4a2c-a1a5-b6fc6ddc7ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:24.029775 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfc20c-99f9-4edd-9f6c-d1ecb3a744b9 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:24.046155 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:24.065172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752b284-f58e-4c62-97b9-c5904bd4e0cc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xOxDz7GiTayhtRDpkq1XVw, audit_chain_id=['xOxDz7GiTayhtRDpkq1XVw']) at 0x7f8a0fdd50d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:24.065750 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752b284-f58e-4c62-97b9-c5904bd4e0cc None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:24.066036 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752b284-f58e-4c62-97b9-c5904bd4e0cc None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:24.066313 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752b284-f58e-4c62-97b9-c5904bd4e0cc None admin] PATH_INFO: `/v3/projects` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:24.067058 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752b284-f58e-4c62-97b9-c5904bd4e0cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:24.067367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752b284-f58e-4c62-97b9-c5904bd4e0cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:24.068786 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752b284-f58e-4c62-97b9-c5904bd4e0cc None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:24.082714 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 327/653] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:24.089173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752b284-f58e-4c62-97b9-c5904bd4e0cc None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:24.105691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 327/654] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:48:24.127147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfa98e-f532-4a2c-a1a5-b6fc6ddc7ea5 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:24.187546 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:24.194535 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752b284-f58e-4c62-97b9-c5904bd4e0cc None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:24.232251 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb96bfa-9ba6-4d47-896d-2cd177214c9f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xOxDz7GiTayhtRDpkq1XVw, audit_chain_id=['xOxDz7GiTayhtRDpkq1XVw']) at 0x7f8a0fe3a430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:24.233020 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb96bfa-9ba6-4d47-896d-2cd177214c9f None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:24.233225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb96bfa-9ba6-4d47-896d-2cd177214c9f None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:24.233506 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb96bfa-9ba6-4d47-896d-2cd177214c9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:24.234644 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb96bfa-9ba6-4d47-896d-2cd177214c9f None admin] RBAC: Adding query filter params (role.id=6ca03befbf3a456eae350bc7e583488f, scope.project.id=2d1b44363d694c60867ec29af4f9d01e, user.id=a2528d7506a5481f8fa6bb5012b4a9dd) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:24.235025 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb96bfa-9ba6-4d47-896d-2cd177214c9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:24.236718 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb96bfa-9ba6-4d47-896d-2cd177214c9f None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:24.243497 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 328/655] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:48:24 2022] GET /identity/v3/role_assignments?user.id=a2528d7506a5481f8fa6bb5012b4a9dd&scope.project.id=2d1b44363d694c60867ec29af4f9d01e&role.id=6ca03befbf3a456eae350bc7e583488f => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:24.248214 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfa98e-f532-4a2c-a1a5-b6fc6ddc7ea5 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:24.290972 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520acb4-5343-43f6-8b3d-da248ce52ede None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4H-vUTszS-CCISL1PT_UpA, audit_chain_id=['4H-vUTszS-CCISL1PT_UpA']) at 0x7f8a140ba4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:24.291654 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520acb4-5343-43f6-8b3d-da248ce52ede None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:24.291948 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520acb4-5343-43f6-8b3d-da248ce52ede None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:24.292329 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520acb4-5343-43f6-8b3d-da248ce52ede None admin] PATH_INFO: `/v3/services/image` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:24.292978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520acb4-5343-43f6-8b3d-da248ce52ede None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:24.294495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520acb4-5343-43f6-8b3d-da248ce52ede None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:24.307268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-d520acb4-5343-43f6-8b3d-da248ce52ede None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:48:24.307268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:24.307268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:24.307268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:24.307268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:24.307268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:24.307268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:24.307268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:24.307268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:48:24.307268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:24.307268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:24.307268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:24.307268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:24.307268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:24.307268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:24.307268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:24.307268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:24.310071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:24.310071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:24.310071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:24.310071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:24.310071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:24.310071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:24.310071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:24.310071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:24.310071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:24.310071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:24.310071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:24.310071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:24.310071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:24.310071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:24.310071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:24.310071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:24.312015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:24.312015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:24.312015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:24.312015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:24.312015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:24.312015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:24.312015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:24.312015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:24.312015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:24.312015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:24.312015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:24.312015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:24.312015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:48:24.312015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:24.312015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 328/656] 10.222.0.47 () {56 vars in 1105 bytes} [Mon Jul 25 22:48:24 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:48:24.318776 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb96bfa-9ba6-4d47-896d-2cd177214c9f None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:24.366431 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:24.433696 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb96bfa-9ba6-4d47-896d-2cd177214c9f None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:24.469780 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b414e-0b07-4df4-9e6d-46caf84a3d7c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4H-vUTszS-CCISL1PT_UpA, audit_chain_id=['4H-vUTszS-CCISL1PT_UpA']) at 0x7f8a155235b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:24.470412 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b414e-0b07-4df4-9e6d-46caf84a3d7c None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:24.470696 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b414e-0b07-4df4-9e6d-46caf84a3d7c None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:24.470971 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b414e-0b07-4df4-9e6d-46caf84a3d7c None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:24.471649 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b414e-0b07-4df4-9e6d-46caf84a3d7c None admin] RBAC: Adding query filter params (name=image) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:24.471955 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b414e-0b07-4df4-9e6d-46caf84a3d7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:24.473321 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b414e-0b07-4df4-9e6d-46caf84a3d7c None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:24.478346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 329/657] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:24.486662 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520acb4-5343-43f6-8b3d-da248ce52ede None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:24.602828 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520acb4-5343-43f6-8b3d-da248ce52ede None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:24.618108 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:24.640802 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102aeb1-c2af-4d42-a568-5ef8fc364122 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4H-vUTszS-CCISL1PT_UpA, audit_chain_id=['4H-vUTszS-CCISL1PT_UpA']) at 0x7f8a0fca7d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:24.641702 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102aeb1-c2af-4d42-a568-5ef8fc364122 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:24.642173 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102aeb1-c2af-4d42-a568-5ef8fc364122 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:24.642600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102aeb1-c2af-4d42-a568-5ef8fc364122 None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:24.643431 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102aeb1-c2af-4d42-a568-5ef8fc364122 None admin] RBAC: Adding query filter params (type=image) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:24.643887 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102aeb1-c2af-4d42-a568-5ef8fc364122 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:24.645432 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102aeb1-c2af-4d42-a568-5ef8fc364122 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:24.652758 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 329/658] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:24.877509 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1606f95-9fa3-45b3-92a2-4421109a372e None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:24.877969 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1606f95-9fa3-45b3-92a2-4421109a372e None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:24.878366 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1606f95-9fa3-45b3-92a2-4421109a372e None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:24.880061 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 330/659] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:24.886371 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b73b91-8e7a-4e5a-8f8e-ba887e042800 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:24.886812 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b73b91-8e7a-4e5a-8f8e-ba887e042800 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:24.887242 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b73b91-8e7a-4e5a-8f8e-ba887e042800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:24.908046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-d7b73b91-8e7a-4e5a-8f8e-ba887e042800 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:24.909256 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-d7b73b91-8e7a-4e5a-8f8e-ba887e042800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:24.989612 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 330/660] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:48:25.012081 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1606f95-9fa3-45b3-92a2-4421109a372e None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:25.118897 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1606f95-9fa3-45b3-92a2-4421109a372e None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:25.121967 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:25.158503 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb065e-2df7-463d-bfc8-e0b714321ca2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=j8PIB9UdQjifkL54hKPz7w, audit_chain_id=['j8PIB9UdQjifkL54hKPz7w']) at 0x7f8a0fdc39a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:25.159085 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb065e-2df7-463d-bfc8-e0b714321ca2 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:25.159369 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb065e-2df7-463d-bfc8-e0b714321ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:25.159650 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb065e-2df7-463d-bfc8-e0b714321ca2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:25.160304 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb065e-2df7-463d-bfc8-e0b714321ca2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:25.161879 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb065e-2df7-463d-bfc8-e0b714321ca2 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:25.175003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-38fb065e-2df7-463d-bfc8-e0b714321ca2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:48:25.175003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:25.175003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:25.175003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:25.175003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:25.175003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:25.175003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:25.175003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:25.175003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:48:25.175003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:25.175003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:25.175003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:25.175003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:25.175003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:25.175003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:25.175003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:25.176042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:25.176042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:25.176042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:25.176042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:25.176042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:25.176042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:25.176042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:25.176042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:25.176042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:25.176042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:25.176042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:25.176042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:25.176042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:25.176042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:25.176042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:25.176042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:25.176886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:25.176886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:25.176886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:25.176886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:25.176886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:25.176886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:25.176886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:25.176886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:25.176886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:25.176886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:25.176886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:25.176886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:25.176886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:25.176886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:48:25.176886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:25.176886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 331/661] 10.222.0.47 () {56 vars in 1129 bytes} [Mon Jul 25 22:48:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:25.183486 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b73b91-8e7a-4e5a-8f8e-ba887e042800 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:25.290601 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b73b91-8e7a-4e5a-8f8e-ba887e042800 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:25.300910 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:25.307114 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd2e93-d4e2-498e-ada9-fe8c48253682 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:25.307622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd2e93-d4e2-498e-ada9-fe8c48253682 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:25.307699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd2e93-d4e2-498e-ada9-fe8c48253682 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:25.312775 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 332/662] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:25.314392 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b20c6f-5042-4216-b207-a774ebf4c59f None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:25.314750 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b20c6f-5042-4216-b207-a774ebf4c59f None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:25.315100 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b20c6f-5042-4216-b207-a774ebf4c59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:25.328897 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d10035-863e-414a-99ce-b14b2ebfea5d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=j8PIB9UdQjifkL54hKPz7w, audit_chain_id=['j8PIB9UdQjifkL54hKPz7w']) at 0x7f8a0fe46eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:25.329531 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d10035-863e-414a-99ce-b14b2ebfea5d None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:25.329847 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d10035-863e-414a-99ce-b14b2ebfea5d None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:25.330130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d10035-863e-414a-99ce-b14b2ebfea5d None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:25.330815 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d10035-863e-414a-99ce-b14b2ebfea5d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:25.331123 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d10035-863e-414a-99ce-b14b2ebfea5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:25.332506 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d10035-863e-414a-99ce-b14b2ebfea5d None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:25.335893 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-71b20c6f-5042-4216-b207-a774ebf4c59f None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:25.337291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 331/663] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Jul 25 22:48:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:25.337820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-71b20c6f-5042-4216-b207-a774ebf4c59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:25.346550 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d10035-863e-414a-99ce-b14b2ebfea5d None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:25.437818 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 333/664] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:48:25.465870 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b20c6f-5042-4216-b207-a774ebf4c59f None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:25.469306 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d10035-863e-414a-99ce-b14b2ebfea5d None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:25.506786 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6527e-2041-4f54-aa54-a810293ec0fb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=j8PIB9UdQjifkL54hKPz7w, audit_chain_id=['j8PIB9UdQjifkL54hKPz7w']) at 0x7f8a0fe136d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:25.507469 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6527e-2041-4f54-aa54-a810293ec0fb None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:25.507829 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6527e-2041-4f54-aa54-a810293ec0fb None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:25.508119 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6527e-2041-4f54-aa54-a810293ec0fb None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:25.508808 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6527e-2041-4f54-aa54-a810293ec0fb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:25.509179 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6527e-2041-4f54-aa54-a810293ec0fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:25.511167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f6527e-2041-4f54-aa54-a810293ec0fb None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:25.516844 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 332/665] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Jul 25 22:48:25 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:25.588684 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:25.593770 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b20c6f-5042-4216-b207-a774ebf4c59f None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:25.631864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd6e95-090b-409c-890c-bf9aa4110157 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=hggOFtJAT1u2q6j9xgcadg, audit_chain_id=['hggOFtJAT1u2q6j9xgcadg']) at 0x7f8a0fdd5520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:25.632794 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd6e95-090b-409c-890c-bf9aa4110157 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:25.633253 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd6e95-090b-409c-890c-bf9aa4110157 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:25.633729 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd6e95-090b-409c-890c-bf9aa4110157 None admin] PATH_INFO: `/v3/services/network` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:25.635079 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd6e95-090b-409c-890c-bf9aa4110157 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:25.636931 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd6e95-090b-409c-890c-bf9aa4110157 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:25.647067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-90cd6e95-090b-409c-890c-bf9aa4110157 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:48:25.647067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:25.647067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:25.647067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:25.647067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:25.647067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:25.647067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:25.647067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:25.647067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:48:25.647067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:25.647067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:25.647067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:25.647067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:25.647067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:25.647067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:25.647067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:25.647067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:25.648331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:25.648331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:25.648331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:25.648331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:25.648331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:25.648331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:25.648331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:25.648331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:25.648331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:25.648331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:25.648331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:25.648331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:25.648331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:25.648331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:25.648331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:25.648331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:25.649358 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:25.649358 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:25.649358 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:25.649358 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:25.649358 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:25.649358 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:25.649358 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:25.649358 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:25.649358 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:25.649358 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:25.649358 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:25.649358 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:25.649358 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:48:25.649358 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:25.657241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 334/666] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:25 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:48:25.662747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6527e-2041-4f54-aa54-a810293ec0fb None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:25.704469 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:25.779854 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6527e-2041-4f54-aa54-a810293ec0fb None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:25.815330 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3919a92-fe7c-4e16-bf7f-ffa2f101d848 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=hggOFtJAT1u2q6j9xgcadg, audit_chain_id=['hggOFtJAT1u2q6j9xgcadg']) at 0x7f8a0fde2250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:25.815961 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3919a92-fe7c-4e16-bf7f-ffa2f101d848 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:25.816248 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3919a92-fe7c-4e16-bf7f-ffa2f101d848 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:25.816531 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3919a92-fe7c-4e16-bf7f-ffa2f101d848 None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:25.817207 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3919a92-fe7c-4e16-bf7f-ffa2f101d848 None admin] RBAC: Adding query filter params (name=network) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:25.817517 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3919a92-fe7c-4e16-bf7f-ffa2f101d848 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:25.818928 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3919a92-fe7c-4e16-bf7f-ffa2f101d848 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:25.824385 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 333/667] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 22:48:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:25.830045 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd6e95-090b-409c-890c-bf9aa4110157 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:25.938623 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd6e95-090b-409c-890c-bf9aa4110157 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:25.974503 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b5ecd-3d8f-4c3d-ae68-5bf1e9ec63b1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=hggOFtJAT1u2q6j9xgcadg, audit_chain_id=['hggOFtJAT1u2q6j9xgcadg']) at 0x7f8a0fd1ee50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:25.975484 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b5ecd-3d8f-4c3d-ae68-5bf1e9ec63b1 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:25.975966 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b5ecd-3d8f-4c3d-ae68-5bf1e9ec63b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:25.976454 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b5ecd-3d8f-4c3d-ae68-5bf1e9ec63b1 None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:25.977324 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b5ecd-3d8f-4c3d-ae68-5bf1e9ec63b1 None admin] RBAC: Adding query filter params (type=network) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:25.977849 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b5ecd-3d8f-4c3d-ae68-5bf1e9ec63b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:25.979450 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b5ecd-3d8f-4c3d-ae68-5bf1e9ec63b1 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:25.989692 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 335/668] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 22:48:25 2022] GET /identity/v3/services?type=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:26.636170 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1c373-0d5f-4b01-843a-e5178c3543ff None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:26.637193 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1c373-0d5f-4b01-843a-e5178c3543ff None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:26.637770 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1c373-0d5f-4b01-843a-e5178c3543ff None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:26.639564 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 334/669] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:26.645534 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6852bc-5c43-4ebe-8053-b080bc50264d None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:26.646424 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6852bc-5c43-4ebe-8053-b080bc50264d None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:26.646907 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6852bc-5c43-4ebe-8053-b080bc50264d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:26.665483 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-4c6852bc-5c43-4ebe-8053-b080bc50264d None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:26.667181 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-4c6852bc-5c43-4ebe-8053-b080bc50264d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:26.688992 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:26.741767 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 336/670] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:48:26.764219 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1c373-0d5f-4b01-843a-e5178c3543ff None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:26.876482 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:26.882551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1c373-0d5f-4b01-843a-e5178c3543ff None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:26.925897 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494dc5a5-b911-410e-8976-27058614a1f2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9dXlSQpgSEOhe-vifsPrRA, audit_chain_id=['9dXlSQpgSEOhe-vifsPrRA']) at 0x7f8a0fd52e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:26.926947 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dc5a5-b911-410e-8976-27058614a1f2 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:26.927621 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dc5a5-b911-410e-8976-27058614a1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:26.928103 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dc5a5-b911-410e-8976-27058614a1f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:26.939585 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494dc5a5-b911-410e-8976-27058614a1f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:26.944704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-494dc5a5-b911-410e-8976-27058614a1f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:48:26.944704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:26.944704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:26.944704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:26.944704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:26.944704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:26.944704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:26.944704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:26.944704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:26.944704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:26.944704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:26.944704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:26.944704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:26.944704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:26.944704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:26.944704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:26.945779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:26.945779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:26.945779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:26.945779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:26.945779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:26.945779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:26.945779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:26.945779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:26.945779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:26.945779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:26.945779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:26.945779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:26.945779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:26.945779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:26.945779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:26.945779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:26.946639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:26.946639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:26.946639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:26.946639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:26.946639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:26.946639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:26.946639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:26.946639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:26.946639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:26.946639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:26.946639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:48:26.946639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:26.950005 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 335/671] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 22:48:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:26.955694 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6852bc-5c43-4ebe-8053-b080bc50264d None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:27.058988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4823c5-190f-4c09-9a92-0198fbee3bcb None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:27.059266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4823c5-190f-4c09-9a92-0198fbee3bcb None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:27.059547 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4823c5-190f-4c09-9a92-0198fbee3bcb None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:27.064555 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 336/672] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:48:27.066234 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150dc87-5d8a-43e4-ac6b-b97e12de71c2 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:27.066740 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150dc87-5d8a-43e4-ac6b-b97e12de71c2 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:27.067237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150dc87-5d8a-43e4-ac6b-b97e12de71c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:27.074719 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6852bc-5c43-4ebe-8053-b080bc50264d None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:27.086200 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-0150dc87-5d8a-43e4-ac6b-b97e12de71c2 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:27.087734 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-0150dc87-5d8a-43e4-ac6b-b97e12de71c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:27.110240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6cfb1-8c02-482a-b38f-04caa35a0c28 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9dXlSQpgSEOhe-vifsPrRA, audit_chain_id=['9dXlSQpgSEOhe-vifsPrRA']) at 0x7f8a0fd64580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:27.110867 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6cfb1-8c02-482a-b38f-04caa35a0c28 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:27.111153 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6cfb1-8c02-482a-b38f-04caa35a0c28 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:27.111435 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6cfb1-8c02-482a-b38f-04caa35a0c28 None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:27.112154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6cfb1-8c02-482a-b38f-04caa35a0c28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:27.112461 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6cfb1-8c02-482a-b38f-04caa35a0c28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:27.113854 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6cfb1-8c02-482a-b38f-04caa35a0c28 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:27.125628 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 337/673] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:48:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:27.131652 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6cfb1-8c02-482a-b38f-04caa35a0c28 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:27.177947 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:27.185689 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 337/674] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:48:27.204368 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150dc87-5d8a-43e4-ac6b-b97e12de71c2 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:27.255862 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6cfb1-8c02-482a-b38f-04caa35a0c28 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:27.290486 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de81fba-9504-45bf-acce-5924b9340ccf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9dXlSQpgSEOhe-vifsPrRA, audit_chain_id=['9dXlSQpgSEOhe-vifsPrRA']) at 0x7f8a0fe1f7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:27.292170 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de81fba-9504-45bf-acce-5924b9340ccf None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:27.292548 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de81fba-9504-45bf-acce-5924b9340ccf None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:27.292919 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de81fba-9504-45bf-acce-5924b9340ccf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:27.305081 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de81fba-9504-45bf-acce-5924b9340ccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:27.307636 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de81fba-9504-45bf-acce-5924b9340ccf None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:27.323206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-7de81fba-9504-45bf-acce-5924b9340ccf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:27.323206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:27.323206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:27.323206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:27.323206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:27.323206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:27.323206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:27.323206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:27.323206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:27.323206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:27.323206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:27.323206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:27.323206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:27.323206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:27.323206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:27.324280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:27.324280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:27.324280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:27.324280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:27.324280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:27.324280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:27.324280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:27.324280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:27.324280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:27.324280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:27.324280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:27.324280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:27.324280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:27.324280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:27.324280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:27.324280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:27.324280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:27.325172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:27.325172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:27.325172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:27.325172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:27.330247 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:27.330375 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 338/675] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:27.332050 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de81fba-9504-45bf-acce-5924b9340ccf None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:27.339148 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150dc87-5d8a-43e4-ac6b-b97e12de71c2 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:27.385603 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15628dc-003b-40e7-b493-1c4a98c6cf8d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oXV8rFF-Tc2YWjzVuj0cmw, audit_chain_id=['oXV8rFF-Tc2YWjzVuj0cmw']) at 0x7f8a0fd55a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:27.387090 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15628dc-003b-40e7-b493-1c4a98c6cf8d None admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:27.387620 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15628dc-003b-40e7-b493-1c4a98c6cf8d None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:27.388358 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15628dc-003b-40e7-b493-1c4a98c6cf8d None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:27.389451 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15628dc-003b-40e7-b493-1c4a98c6cf8d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:27.391644 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15628dc-003b-40e7-b493-1c4a98c6cf8d None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:27.414893 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:27.418404 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 338/676] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Jul 25 22:48:27 2022] POST /identity/v3/services => generated 242 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:48:27.458400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de81fba-9504-45bf-acce-5924b9340ccf None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:27.515588 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992cdbe-8f88-455a-a105-6a8bc07291be None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9dXlSQpgSEOhe-vifsPrRA, audit_chain_id=['9dXlSQpgSEOhe-vifsPrRA']) at 0x7f8a0fd147c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:27.516239 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992cdbe-8f88-455a-a105-6a8bc07291be None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:27.516582 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992cdbe-8f88-455a-a105-6a8bc07291be None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:27.516919 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992cdbe-8f88-455a-a105-6a8bc07291be None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:27.517710 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992cdbe-8f88-455a-a105-6a8bc07291be None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:27.518022 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992cdbe-8f88-455a-a105-6a8bc07291be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:27.519551 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992cdbe-8f88-455a-a105-6a8bc07291be None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:27.534653 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 339/677] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:27.543288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15628dc-003b-40e7-b493-1c4a98c6cf8d None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:27.660246 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15628dc-003b-40e7-b493-1c4a98c6cf8d None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:27.698706 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598db95-3d10-4eba-a721-f0ce13d18a84 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9dXlSQpgSEOhe-vifsPrRA, audit_chain_id=['9dXlSQpgSEOhe-vifsPrRA']) at 0x7f8a0fd83610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:27.699376 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598db95-3d10-4eba-a721-f0ce13d18a84 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:27.699664 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598db95-3d10-4eba-a721-f0ce13d18a84 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:27.699940 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598db95-3d10-4eba-a721-f0ce13d18a84 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:27.708285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598db95-3d10-4eba-a721-f0ce13d18a84 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:27.709767 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598db95-3d10-4eba-a721-f0ce13d18a84 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:27.722354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-d598db95-3d10-4eba-a721-f0ce13d18a84 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:48:27.722354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:27.722354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:27.722354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:27.722354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:27.722354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:27.722354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:27.722354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:27.722354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:27.722354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:27.722354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:27.722354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:27.722354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:27.722354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:27.722354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:27.722354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:27.723315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:27.723315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:27.723315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:27.723315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:27.723315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:27.723315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:27.723315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:27.723315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:27.723315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:27.723315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:27.723315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:27.723315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:27.723315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:27.723315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:27.723315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:27.723315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:27.723315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:27.723315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:27.724652 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:27.724652 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:27.724652 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:27.724652 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:27.724652 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:27.724652 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:27.724652 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:27.724652 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:27.724652 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:48:27.724652 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:27.724652 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 339/678] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Jul 25 22:48:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:27.729699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992cdbe-8f88-455a-a105-6a8bc07291be None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:27.845757 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992cdbe-8f88-455a-a105-6a8bc07291be None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:27.873200 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:27.882960 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1aeca1-0218-49aa-993a-4d23847d61e8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9dXlSQpgSEOhe-vifsPrRA, audit_chain_id=['9dXlSQpgSEOhe-vifsPrRA']) at 0x7f8a0fd1ee50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:27.883598 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1aeca1-0218-49aa-993a-4d23847d61e8 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:27.883883 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1aeca1-0218-49aa-993a-4d23847d61e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:27.884224 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1aeca1-0218-49aa-993a-4d23847d61e8 None admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:27.885506 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1aeca1-0218-49aa-993a-4d23847d61e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:27.886002 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1aeca1-0218-49aa-993a-4d23847d61e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:27.887276 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1aeca1-0218-49aa-993a-4d23847d61e8 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:27.906501 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 340/679] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Jul 25 22:48:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:27.911991 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598db95-3d10-4eba-a721-f0ce13d18a84 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:27.925477 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:27.980719 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f66309-a6ee-4db1-9c07-637bcebccf18 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:27.981056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f66309-a6ee-4db1-9c07-637bcebccf18 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:27.981282 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f66309-a6ee-4db1-9c07-637bcebccf18 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:27.983558 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 341/680] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:48:27.989193 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541824f-2978-46b3-a1eb-8026a2ca4462 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:27.989493 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541824f-2978-46b3-a1eb-8026a2ca4462 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:27.989814 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541824f-2978-46b3-a1eb-8026a2ca4462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:28.008934 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-e541824f-2978-46b3-a1eb-8026a2ca4462 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:28.010732 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-e541824f-2978-46b3-a1eb-8026a2ca4462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:28.035640 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598db95-3d10-4eba-a721-f0ce13d18a84 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:28.074854 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa08a5-637c-44ec-97b5-6ff1c7d84ae5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9dXlSQpgSEOhe-vifsPrRA, audit_chain_id=['9dXlSQpgSEOhe-vifsPrRA']) at 0x7f8a0fd66370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:28.075931 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa08a5-637c-44ec-97b5-6ff1c7d84ae5 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:28.076422 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa08a5-637c-44ec-97b5-6ff1c7d84ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:28.077034 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa08a5-637c-44ec-97b5-6ff1c7d84ae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:28.089619 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa08a5-637c-44ec-97b5-6ff1c7d84ae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:28.089944 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 342/681] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:27 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:48:28.091648 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa08a5-637c-44ec-97b5-6ff1c7d84ae5 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:28.107288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-61fa08a5-637c-44ec-97b5-6ff1c7d84ae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:28.107288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:28.107288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:28.107288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:28.107288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:28.107288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:28.107288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:28.107288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:28.107288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:28.107288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:28.107288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:28.107288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:28.107288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:28.107288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:28.107288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:28.108257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:28.108257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:28.108257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:28.108257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:28.108257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:28.108257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:28.108257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:28.108257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:28.108257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:28.108257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:28.108257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:28.108257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:28.108257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:28.108257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:28.108257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:28.108257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:28.108257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:28.109127 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:28.109127 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:28.109127 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:28.109127 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:28.109355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541824f-2978-46b3-a1eb-8026a2ca4462 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:28.111648 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 340/682] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:28.119988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa08a5-637c-44ec-97b5-6ff1c7d84ae5 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:28.200265 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:28.236514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541824f-2978-46b3-a1eb-8026a2ca4462 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:28.245813 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa08a5-637c-44ec-97b5-6ff1c7d84ae5 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:28.268242 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:28.286580 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a683463-7d51-4ad4-b9ca-dad6afb857b9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9dXlSQpgSEOhe-vifsPrRA, audit_chain_id=['9dXlSQpgSEOhe-vifsPrRA']) at 0x7f8a0fe0c3a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:28.287664 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a683463-7d51-4ad4-b9ca-dad6afb857b9 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:28.288175 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a683463-7d51-4ad4-b9ca-dad6afb857b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:28.288670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a683463-7d51-4ad4-b9ca-dad6afb857b9 None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:28.289678 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a683463-7d51-4ad4-b9ca-dad6afb857b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:28.290248 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a683463-7d51-4ad4-b9ca-dad6afb857b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:28.291960 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a683463-7d51-4ad4-b9ca-dad6afb857b9 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:28.298702 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b723994-278a-4ce5-8dd0-d73d44f6a27e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=YcHGFgQ5TW-q75S-TaSwmQ, audit_chain_id=['YcHGFgQ5TW-q75S-TaSwmQ']) at 0x7f8a0fdc3310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:28.299336 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b723994-278a-4ce5-8dd0-d73d44f6a27e None admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:28.299623 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b723994-278a-4ce5-8dd0-d73d44f6a27e None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:28.299902 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b723994-278a-4ce5-8dd0-d73d44f6a27e None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:28.300606 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b723994-278a-4ce5-8dd0-d73d44f6a27e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:28.302129 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b723994-278a-4ce5-8dd0-d73d44f6a27e None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:28.312057 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 341/683] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:28.313422 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a683463-7d51-4ad4-b9ca-dad6afb857b9 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:28.341946 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 343/684] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Jul 25 22:48:28 2022] POST /identity/v3/services => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:48:28.344065 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05ce44-4e8c-44fd-b61b-618332784a67 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:28.344568 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05ce44-4e8c-44fd-b61b-618332784a67 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:28.345083 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05ce44-4e8c-44fd-b61b-618332784a67 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:28.346829 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 344/685] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:28.352650 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4d329-15bf-41c1-8b53-969e596dab6e None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:28.353400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4d329-15bf-41c1-8b53-969e596dab6e None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:28.353908 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4d329-15bf-41c1-8b53-969e596dab6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:28.392292 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-70f4d329-15bf-41c1-8b53-969e596dab6e None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:28.394063 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-70f4d329-15bf-41c1-8b53-969e596dab6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:28.433201 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a683463-7d51-4ad4-b9ca-dad6afb857b9 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:28.488223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:28.515361 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79c6fb-b981-43aa-818e-061614ec30db None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9dXlSQpgSEOhe-vifsPrRA, audit_chain_id=['9dXlSQpgSEOhe-vifsPrRA']) at 0x7f8a0fd26190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:28.516451 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79c6fb-b981-43aa-818e-061614ec30db None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:28.516856 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79c6fb-b981-43aa-818e-061614ec30db None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:28.517763 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79c6fb-b981-43aa-818e-061614ec30db None admin] PATH_INFO: `/v3/projects/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:28.526245 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79c6fb-b981-43aa-818e-061614ec30db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:28.527911 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79c6fb-b981-43aa-818e-061614ec30db None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:28.543716 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-3d79c6fb-b981-43aa-818e-061614ec30db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:28.543716 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:28.543716 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:28.543716 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:28.543716 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:28.543716 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:28.543716 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:28.543716 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:28.543716 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:28.543716 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:28.543716 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:28.543716 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:28.543716 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:28.543716 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:28.543716 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:28.544850 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:28.544850 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:28.544850 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:28.544850 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:28.544850 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:28.544850 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:28.544850 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:28.544850 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:28.544850 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:28.544850 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:28.544850 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:28.544850 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:28.544850 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:28.544850 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:28.544850 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:28.544850 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:28.544850 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:28.546041 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:28.546041 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:28.546041 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:28.546041 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:28.546041 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:28.546041 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:28.546041 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:28.546041 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:28.552978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 342/686] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:28.554201 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79c6fb-b981-43aa-818e-061614ec30db None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:28.565998 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 345/687] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:28 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:48:28.589274 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4d329-15bf-41c1-8b53-969e596dab6e None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:28.708286 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79c6fb-b981-43aa-818e-061614ec30db None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:28.741831 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4d329-15bf-41c1-8b53-969e596dab6e None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:28.745920 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:28.756327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b016853-738a-4f56-a8af-a85087d53d45 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9dXlSQpgSEOhe-vifsPrRA, audit_chain_id=['9dXlSQpgSEOhe-vifsPrRA']) at 0x7f8a0fc83610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:28.757266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b016853-738a-4f56-a8af-a85087d53d45 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:28.757768 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b016853-738a-4f56-a8af-a85087d53d45 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:28.758229 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b016853-738a-4f56-a8af-a85087d53d45 None admin] PATH_INFO: `/v3/projects` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:28.759160 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b016853-738a-4f56-a8af-a85087d53d45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:28.759712 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b016853-738a-4f56-a8af-a85087d53d45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:28.761352 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b016853-738a-4f56-a8af-a85087d53d45 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:28.774976 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 343/688] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:28.781002 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b016853-738a-4f56-a8af-a85087d53d45 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:28.792223 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45832e-2906-48a5-b836-42ec2a31bc9e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NOxaUExrSL6uLL8NPQ6Hrw, audit_chain_id=['NOxaUExrSL6uLL8NPQ6Hrw']) at 0x7f8a0fdc8b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:28.793155 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45832e-2906-48a5-b836-42ec2a31bc9e None admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:28.793445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45832e-2906-48a5-b836-42ec2a31bc9e None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:28.793888 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45832e-2906-48a5-b836-42ec2a31bc9e None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:28.794696 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45832e-2906-48a5-b836-42ec2a31bc9e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:28.796245 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45832e-2906-48a5-b836-42ec2a31bc9e None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:28.818180 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 346/689] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Jul 25 22:48:28 2022] POST /identity/v3/services => generated 240 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:48:28.838507 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:28.911882 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b016853-738a-4f56-a8af-a85087d53d45 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:28.960501 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab8a46-7508-41ad-a03d-d3733dfd70b7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9dXlSQpgSEOhe-vifsPrRA, audit_chain_id=['9dXlSQpgSEOhe-vifsPrRA']) at 0x7f8a0fd0cd30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:28.961262 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab8a46-7508-41ad-a03d-d3733dfd70b7 None admin] REQUEST_METHOD: `PUT` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:28.961554 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab8a46-7508-41ad-a03d-d3733dfd70b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:28.961872 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab8a46-7508-41ad-a03d-d3733dfd70b7 None admin] PATH_INFO: `/v3/projects/2d1b44363d694c60867ec29af4f9d01e/users/a2528d7506a5481f8fa6bb5012b4a9dd/roles/6ca03befbf3a456eae350bc7e583488f` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:28.964621 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab8a46-7508-41ad-a03d-d3733dfd70b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d1b44363d694c60867ec29af4f9d01e, user_id=a2528d7506a5481f8fa6bb5012b4a9dd, role_id=6ca03befbf3a456eae350bc7e583488f)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:28.966302 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab8a46-7508-41ad-a03d-d3733dfd70b7 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:28.984816 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 344/690] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 22:48:28 2022] PUT /identity/v3/projects/2d1b44363d694c60867ec29af4f9d01e/users/a2528d7506a5481f8fa6bb5012b4a9dd/roles/6ca03befbf3a456eae350bc7e583488f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:48:29.879451 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c17bb9-0e3b-4238-8101-00eda8fc6515 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:29.879975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c17bb9-0e3b-4238-8101-00eda8fc6515 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:29.880052 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c17bb9-0e3b-4238-8101-00eda8fc6515 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:29.881628 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 347/691] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:29.887466 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a1043-1994-4054-8f9a-be4623cf7cc2 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:29.887892 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a1043-1994-4054-8f9a-be4623cf7cc2 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:29.888073 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a1043-1994-4054-8f9a-be4623cf7cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:29.906941 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-5d6a1043-1994-4054-8f9a-be4623cf7cc2 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:29.908112 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-5d6a1043-1994-4054-8f9a-be4623cf7cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:29.977098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 345/692] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:29 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:48:30.003541 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c17bb9-0e3b-4238-8101-00eda8fc6515 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:30.120538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c17bb9-0e3b-4238-8101-00eda8fc6515 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:30.157341 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad8792-e3f9-43bf-bfad-d45d65687c20 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HHuQxfbbS2miQFc0ShyxTQ, audit_chain_id=['HHuQxfbbS2miQFc0ShyxTQ']) at 0x7f8a0fd32d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:30.157947 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad8792-e3f9-43bf-bfad-d45d65687c20 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:30.158232 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad8792-e3f9-43bf-bfad-d45d65687c20 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:30.158509 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad8792-e3f9-43bf-bfad-d45d65687c20 None admin] PATH_INFO: `/v3/services/image` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:30.159152 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad8792-e3f9-43bf-bfad-d45d65687c20 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:30.160548 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad8792-e3f9-43bf-bfad-d45d65687c20 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:30.170890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-62ad8792-e3f9-43bf-bfad-d45d65687c20 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:48:30.170890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:30.170890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:30.170890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:30.170890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:30.170890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:30.170890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:30.170890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:30.170890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:48:30.170890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:30.170890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:30.170890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:30.170890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:30.170890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:30.170890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:30.170890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:30.170890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:30.171985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:30.171985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:30.171985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:30.171985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:30.171985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:30.171985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:30.171985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:30.171985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:30.171985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:30.171985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:30.171985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:30.171985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:30.171985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:30.171985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:30.171985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:30.171985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:30.172815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:30.172815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:30.172815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:30.172815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:30.172815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:30.172815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:30.172815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:30.172815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:30.172815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:30.172815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:30.172815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:30.172815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:30.172815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:48:30.172815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:30.172815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 348/693] 10.222.0.47 () {56 vars in 1105 bytes} [Mon Jul 25 22:48:30 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:30.178663 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a1043-1994-4054-8f9a-be4623cf7cc2 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:30.204744 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:30.287785 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a1043-1994-4054-8f9a-be4623cf7cc2 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:30.325556 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c888eef-bd78-4fce-9e39-c53be66f0aad None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HHuQxfbbS2miQFc0ShyxTQ, audit_chain_id=['HHuQxfbbS2miQFc0ShyxTQ']) at 0x7f8a0fd88460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:30.326227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c888eef-bd78-4fce-9e39-c53be66f0aad None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:30.326516 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c888eef-bd78-4fce-9e39-c53be66f0aad None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:30.326799 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c888eef-bd78-4fce-9e39-c53be66f0aad None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:30.327488 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c888eef-bd78-4fce-9e39-c53be66f0aad None admin] RBAC: Adding query filter params (name=image) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:30.327802 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c888eef-bd78-4fce-9e39-c53be66f0aad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:30.329185 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c888eef-bd78-4fce-9e39-c53be66f0aad None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:30.334428 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 346/694] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:30.340783 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad8792-e3f9-43bf-bfad-d45d65687c20 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:30.373431 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:30.450799 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad8792-e3f9-43bf-bfad-d45d65687c20 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:30.487220 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fd9ca-6971-45d4-a9bc-70976a4365c8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HHuQxfbbS2miQFc0ShyxTQ, audit_chain_id=['HHuQxfbbS2miQFc0ShyxTQ']) at 0x7f8a0fd82fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:30.487849 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fd9ca-6971-45d4-a9bc-70976a4365c8 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:30.488134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fd9ca-6971-45d4-a9bc-70976a4365c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:30.488410 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20fd9ca-6971-45d4-a9bc-70976a4365c8 None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:30.489201 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20fd9ca-6971-45d4-a9bc-70976a4365c8 None admin] RBAC: Adding query filter params (type=image) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:30.489513 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20fd9ca-6971-45d4-a9bc-70976a4365c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:30.491065 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20fd9ca-6971-45d4-a9bc-70976a4365c8 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:30.496477 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 349/695] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:30.502284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c888eef-bd78-4fce-9e39-c53be66f0aad None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:30.596066 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:30.609770 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c888eef-bd78-4fce-9e39-c53be66f0aad None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:30.647221 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654198f-3df2-42b7-8a68-57a89b0a70be None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HHuQxfbbS2miQFc0ShyxTQ, audit_chain_id=['HHuQxfbbS2miQFc0ShyxTQ']) at 0x7f8a0fe13130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:30.647881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654198f-3df2-42b7-8a68-57a89b0a70be None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:30.648166 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654198f-3df2-42b7-8a68-57a89b0a70be None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:30.648445 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654198f-3df2-42b7-8a68-57a89b0a70be None admin] PATH_INFO: `/v3/endpoints` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:30.649308 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654198f-3df2-42b7-8a68-57a89b0a70be None admin] RBAC: Adding query filter params (interface=public, service_id=20a33a46fd4347b5aea9e464da040cc0, region_id=RegionOne) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:30.649663 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654198f-3df2-42b7-8a68-57a89b0a70be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:30.651887 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654198f-3df2-42b7-8a68-57a89b0a70be None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:30.661067 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 347/696] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Jul 25 22:48:30 2022] GET /identity/v3/endpoints?service_id=20a33a46fd4347b5aea9e464da040cc0&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:30.667510 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fd9ca-6971-45d4-a9bc-70976a4365c8 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:30.764316 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:30.773256 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20fd9ca-6971-45d4-a9bc-70976a4365c8 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:30.807222 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58339a3c-fa2f-4eed-901e-44d10d6cfd36 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:30.807554 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58339a3c-fa2f-4eed-901e-44d10d6cfd36 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:30.807779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58339a3c-fa2f-4eed-901e-44d10d6cfd36 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:30.809499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 348/697] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:48:30.812906 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe67771-d731-45d4-a547-28530efe0446 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HHuQxfbbS2miQFc0ShyxTQ, audit_chain_id=['HHuQxfbbS2miQFc0ShyxTQ']) at 0x7f8a0fd146d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:30.813531 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe67771-d731-45d4-a547-28530efe0446 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:30.813835 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe67771-d731-45d4-a547-28530efe0446 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:30.814113 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe67771-d731-45d4-a547-28530efe0446 None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:30.814766 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe67771-d731-45d4-a547-28530efe0446 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:30.816125 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe67771-d731-45d4-a547-28530efe0446 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:30.822772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5e7c1-2278-433e-a67d-3f438e34b7a5 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:30.823318 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5e7c1-2278-433e-a67d-3f438e34b7a5 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:30.823821 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5e7c1-2278-433e-a67d-3f438e34b7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:30.825863 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 350/698] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Jul 25 22:48:30 2022] GET /identity/v3/services => generated 1002 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:48:30.848498 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-d4c5e7c1-2278-433e-a67d-3f438e34b7a5 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:30.850101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-d4c5e7c1-2278-433e-a67d-3f438e34b7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:30.927183 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 349/699] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:30 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:48:30.951158 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe67771-d731-45d4-a547-28530efe0446 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:31.073519 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe67771-d731-45d4-a547-28530efe0446 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:31.112801 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29e5a1-d96d-4478-bb1c-9319e83ed04b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xS5N9BEQR0-h0sgpX0T2ew, audit_chain_id=['xS5N9BEQR0-h0sgpX0T2ew']) at 0x7f8a0fe1e040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:31.113463 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29e5a1-d96d-4478-bb1c-9319e83ed04b None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:31.113781 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29e5a1-d96d-4478-bb1c-9319e83ed04b None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:31.114062 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29e5a1-d96d-4478-bb1c-9319e83ed04b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:31.114702 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29e5a1-d96d-4478-bb1c-9319e83ed04b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:31.116084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29e5a1-d96d-4478-bb1c-9319e83ed04b None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:31.126317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-df29e5a1-d96d-4478-bb1c-9319e83ed04b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:48:31.126317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:31.126317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:31.126317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:31.126317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:31.126317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:31.126317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:31.126317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:31.126317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:48:31.126317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:31.126317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:31.126317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:31.126317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:31.126317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:31.126317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:31.126317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:31.127283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:31.127283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:31.127283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:31.127283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:31.127283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:31.127283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:31.127283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:31.127283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:31.127283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:31.127283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:31.127283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:31.127283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:31.127283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:31.127283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:31.127283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:31.127283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:31.128120 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:31.128120 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:31.128120 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:31.128120 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:31.128120 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:31.128120 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:31.128120 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:31.128120 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:31.128120 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:31.128120 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:31.128120 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:31.128120 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:31.128120 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:31.128120 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:48:31.128120 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:31.128120 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 351/700] 10.222.0.47 () {56 vars in 1129 bytes} [Mon Jul 25 22:48:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:31.135998 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5e7c1-2278-433e-a67d-3f438e34b7a5 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:31.223183 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:31.245077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5e7c1-2278-433e-a67d-3f438e34b7a5 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:31.246118 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4909a7-a50a-4945-a56d-fa1f37870a60 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:31.246408 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4909a7-a50a-4945-a56d-fa1f37870a60 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:31.246764 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4909a7-a50a-4945-a56d-fa1f37870a60 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:31.248576 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 352/701] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:48:31.254285 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25395014-b15e-447e-b426-c6ae64266958 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:31.254585 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25395014-b15e-447e-b426-c6ae64266958 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:31.254853 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25395014-b15e-447e-b426-c6ae64266958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:31.275449 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-25395014-b15e-447e-b426-c6ae64266958 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:31.276664 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-25395014-b15e-447e-b426-c6ae64266958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:31.286835 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a762a8-1630-4612-9d93-956514f1d8e4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xS5N9BEQR0-h0sgpX0T2ew, audit_chain_id=['xS5N9BEQR0-h0sgpX0T2ew']) at 0x7f8a0fd26370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:31.287582 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a762a8-1630-4612-9d93-956514f1d8e4 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:31.287871 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a762a8-1630-4612-9d93-956514f1d8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:31.288151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a762a8-1630-4612-9d93-956514f1d8e4 None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:31.288845 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a762a8-1630-4612-9d93-956514f1d8e4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:31.289152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a762a8-1630-4612-9d93-956514f1d8e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:31.290715 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a762a8-1630-4612-9d93-956514f1d8e4 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:31.294243 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:31.296787 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 350/702] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Jul 25 22:48:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:31.302497 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a762a8-1630-4612-9d93-956514f1d8e4 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:31.363941 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 353/703] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:31 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:48:31.390594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25395014-b15e-447e-b426-c6ae64266958 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:31.425181 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a762a8-1630-4612-9d93-956514f1d8e4 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:31.464819 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e43ab-a096-4a5a-90c3-98f089f92377 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xS5N9BEQR0-h0sgpX0T2ew, audit_chain_id=['xS5N9BEQR0-h0sgpX0T2ew']) at 0x7f8a14dd08e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:31.465737 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e43ab-a096-4a5a-90c3-98f089f92377 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:31.466024 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e43ab-a096-4a5a-90c3-98f089f92377 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:31.466298 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e43ab-a096-4a5a-90c3-98f089f92377 None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:31.466975 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e43ab-a096-4a5a-90c3-98f089f92377 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:31.467282 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e43ab-a096-4a5a-90c3-98f089f92377 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:31.468661 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e43ab-a096-4a5a-90c3-98f089f92377 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:31.481137 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 351/704] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Jul 25 22:48:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:31.481137 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84edef7-55f7-4a19-a725-766f3e82ea15 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:31.481137 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84edef7-55f7-4a19-a725-766f3e82ea15 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:31.481137 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84edef7-55f7-4a19-a725-766f3e82ea15 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:31.481137 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 352/705] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:31.483176 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84edef7-55f7-4a19-a725-766f3e82ea15 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:31.496463 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:31.514066 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25395014-b15e-447e-b426-c6ae64266958 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:31.555709 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65839700-9601-4cee-b312-6a5d11c3dd83 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L1ri4bWyQBKya67vqJaunA, audit_chain_id=['L1ri4bWyQBKya67vqJaunA']) at 0x7f8a0fe963d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:31.556388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65839700-9601-4cee-b312-6a5d11c3dd83 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:31.556673 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65839700-9601-4cee-b312-6a5d11c3dd83 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:31.556972 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65839700-9601-4cee-b312-6a5d11c3dd83 None admin] PATH_INFO: `/v3/services/network` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:31.557640 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65839700-9601-4cee-b312-6a5d11c3dd83 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:31.559467 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65839700-9601-4cee-b312-6a5d11c3dd83 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:31.568989 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-65839700-9601-4cee-b312-6a5d11c3dd83 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:48:31.568989 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:31.568989 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:31.568989 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:31.568989 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:31.568989 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:31.568989 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:31.568989 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:31.568989 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:48:31.568989 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:31.568989 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:31.568989 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:31.568989 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:31.568989 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:31.568989 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:31.568989 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:31.568989 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:31.570134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:31.570134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:31.570134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:31.570134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:31.570134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:31.570134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:31.570134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:31.570134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:31.570134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:31.570134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:31.570134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:31.570134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:31.570134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:31.570134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:31.570134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:31.570134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:31.571060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:31.571060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:31.571060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:31.571060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:31.571060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:31.571060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:31.571060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:31.571060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:31.571060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:31.571060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:31.571060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:31.571060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:31.571060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:48:31.571060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:31.571060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 354/706] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:31 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:48:31.576628 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4d36f-7b0f-4dd3-80d3-28950b5dff7e None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:31.576922 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4d36f-7b0f-4dd3-80d3-28950b5dff7e None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:31.577208 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4d36f-7b0f-4dd3-80d3-28950b5dff7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:31.597759 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-d9a4d36f-7b0f-4dd3-80d3-28950b5dff7e None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:31.598953 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-d9a4d36f-7b0f-4dd3-80d3-28950b5dff7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:31.600356 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84edef7-55f7-4a19-a725-766f3e82ea15 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:31.609017 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:31.638315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97528e9-5b41-4218-9e08-c850aee4a29e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xS5N9BEQR0-h0sgpX0T2ew, audit_chain_id=['xS5N9BEQR0-h0sgpX0T2ew']) at 0x7f8a0fe10d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:31.638865 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97528e9-5b41-4218-9e08-c850aee4a29e None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:31.639157 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97528e9-5b41-4218-9e08-c850aee4a29e None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:31.639426 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97528e9-5b41-4218-9e08-c850aee4a29e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:31.640448 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97528e9-5b41-4218-9e08-c850aee4a29e None admin] RBAC: Adding query filter params (interface=public, service_id=f5f3549ff4b147ef90c8a8828ff205a2, region_id=RegionOne) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:31.640760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97528e9-5b41-4218-9e08-c850aee4a29e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:31.642179 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97528e9-5b41-4218-9e08-c850aee4a29e None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:31.647367 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 353/707] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Jul 25 22:48:31 2022] GET /identity/v3/endpoints?service_id=f5f3549ff4b147ef90c8a8828ff205a2&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:31.651619 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97528e9-5b41-4218-9e08-c850aee4a29e None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:31.671248 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 355/708] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:31 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:31.672412 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4d36f-7b0f-4dd3-80d3-28950b5dff7e None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:31.735171 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:31.765388 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97528e9-5b41-4218-9e08-c850aee4a29e None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:31.787637 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4d36f-7b0f-4dd3-80d3-28950b5dff7e None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:31.802398 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e065ae2-d20b-42ce-98e4-57d3f96d5130 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L1ri4bWyQBKya67vqJaunA, audit_chain_id=['L1ri4bWyQBKya67vqJaunA']) at 0x7f8a0fd83940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:31.803027 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e065ae2-d20b-42ce-98e4-57d3f96d5130 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:31.803313 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e065ae2-d20b-42ce-98e4-57d3f96d5130 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:31.803591 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e065ae2-d20b-42ce-98e4-57d3f96d5130 None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:31.804267 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e065ae2-d20b-42ce-98e4-57d3f96d5130 None admin] RBAC: Adding query filter params (name=network) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:31.804571 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e065ae2-d20b-42ce-98e4-57d3f96d5130 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:31.806049 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e065ae2-d20b-42ce-98e4-57d3f96d5130 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:31.811323 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 354/709] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 22:48:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:31.811947 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e065ae2-d20b-42ce-98e4-57d3f96d5130 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:31.829508 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742b222-0520-4437-9331-57c2f4eca2f7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xS5N9BEQR0-h0sgpX0T2ew, audit_chain_id=['xS5N9BEQR0-h0sgpX0T2ew']) at 0x7f8a0fd5f250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:31.830377 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742b222-0520-4437-9331-57c2f4eca2f7 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:31.830670 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742b222-0520-4437-9331-57c2f4eca2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:31.831242 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742b222-0520-4437-9331-57c2f4eca2f7 None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:31.831960 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742b222-0520-4437-9331-57c2f4eca2f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:31.833378 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742b222-0520-4437-9331-57c2f4eca2f7 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:31.840174 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 356/710] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Jul 25 22:48:31 2022] GET /identity/v3/services => generated 1002 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:48:31.840976 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742b222-0520-4437-9331-57c2f4eca2f7 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:31.859677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:31.956756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e065ae2-d20b-42ce-98e4-57d3f96d5130 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:31.970358 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742b222-0520-4437-9331-57c2f4eca2f7 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:32.001294 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbe89d-6e52-4f75-af90-b5d07dd00932 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kQJC0lhBS2a9hoWQl9fwcw, audit_chain_id=['kQJC0lhBS2a9hoWQl9fwcw']) at 0x7f8a0fd2ea90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:32.002177 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbe89d-6e52-4f75-af90-b5d07dd00932 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:32.002461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbe89d-6e52-4f75-af90-b5d07dd00932 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:32.002786 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbe89d-6e52-4f75-af90-b5d07dd00932 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:32.011245 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:32.012728 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24266f0-cde1-46f0-8ab0-6f05b8498725 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L1ri4bWyQBKya67vqJaunA, audit_chain_id=['L1ri4bWyQBKya67vqJaunA']) at 0x7f8a0fd5f0d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:32.013610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24266f0-cde1-46f0-8ab0-6f05b8498725 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:32.015613 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24266f0-cde1-46f0-8ab0-6f05b8498725 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:32.015613 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24266f0-cde1-46f0-8ab0-6f05b8498725 None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:32.015613 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24266f0-cde1-46f0-8ab0-6f05b8498725 None admin] RBAC: Adding query filter params (type=network) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:32.016076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24266f0-cde1-46f0-8ab0-6f05b8498725 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:32.016698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbe89d-6e52-4f75-af90-b5d07dd00932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:48:32.018011 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24266f0-cde1-46f0-8ab0-6f05b8498725 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:32.023020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-7ecbe89d-6e52-4f75-af90-b5d07dd00932 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:48:32.023020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:32.023020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:32.023020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:32.023020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:32.023020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:32.023020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:32.023020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:32.023020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:32.023020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:32.023020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:32.023020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:32.023020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:48:32.023020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:48:32.023020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:48:32.023020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:48:32.024154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:48:32.024154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:48:32.024154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:48:32.024154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:48:32.024154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:32.024154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:32.024154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:32.024154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:32.024154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:32.024154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:32.024154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:32.024154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:32.024154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:32.024154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:32.024154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:32.024154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:32.025780 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:32.025780 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:32.025780 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:32.025780 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:32.025780 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:48:32.025780 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:48:32.025780 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:48:32.025780 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:48:32.025780 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:48:32.025780 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:48:32.025780 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:48:32.025780 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:32.025780 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 355/711] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 22:48:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:32.027368 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 357/712] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 22:48:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:32.032984 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbe89d-6e52-4f75-af90-b5d07dd00932 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:32.033131 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24266f0-cde1-46f0-8ab0-6f05b8498725 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:32.133212 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:32.145565 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbe89d-6e52-4f75-af90-b5d07dd00932 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:32.166730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24266f0-cde1-46f0-8ab0-6f05b8498725 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:32.193942 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c1ceb-d432-48ae-a22b-4ff83a994f6f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kQJC0lhBS2a9hoWQl9fwcw, audit_chain_id=['kQJC0lhBS2a9hoWQl9fwcw']) at 0x7f8a0fca7ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:32.194575 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c1ceb-d432-48ae-a22b-4ff83a994f6f None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:32.194860 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c1ceb-d432-48ae-a22b-4ff83a994f6f None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:32.195161 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c1ceb-d432-48ae-a22b-4ff83a994f6f None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:32.195857 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c1ceb-d432-48ae-a22b-4ff83a994f6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:32.196163 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c1ceb-d432-48ae-a22b-4ff83a994f6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:32.197685 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c1ceb-d432-48ae-a22b-4ff83a994f6f None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:32.206885 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 356/713] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:48:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:32.212339 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c1ceb-d432-48ae-a22b-4ff83a994f6f None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:32.213484 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870ee71-af8d-4335-be24-052b78ffa3e6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L1ri4bWyQBKya67vqJaunA, audit_chain_id=['L1ri4bWyQBKya67vqJaunA']) at 0x7f8a0fde1c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:32.214306 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870ee71-af8d-4335-be24-052b78ffa3e6 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:32.214763 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870ee71-af8d-4335-be24-052b78ffa3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:32.215224 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870ee71-af8d-4335-be24-052b78ffa3e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:32.216250 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870ee71-af8d-4335-be24-052b78ffa3e6 None admin] RBAC: Adding query filter params (interface=public, service_id=8207ff6b468442aca695c68738a0bfd9, region_id=RegionOne) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:32.216790 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870ee71-af8d-4335-be24-052b78ffa3e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:32.218387 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870ee71-af8d-4335-be24-052b78ffa3e6 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:32.232023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 358/714] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Jul 25 22:48:32 2022] GET /identity/v3/endpoints?service_id=8207ff6b468442aca695c68738a0bfd9&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:32.233378 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870ee71-af8d-4335-be24-052b78ffa3e6 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:32.293361 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:32.346591 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870ee71-af8d-4335-be24-052b78ffa3e6 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:32.347948 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c1ceb-d432-48ae-a22b-4ff83a994f6f None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:32.385531 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6801452-76d6-471b-bc16-2fe5df9044b7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L1ri4bWyQBKya67vqJaunA, audit_chain_id=['L1ri4bWyQBKya67vqJaunA']) at 0x7f8a0fdc2ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:32.386578 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6801452-76d6-471b-bc16-2fe5df9044b7 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:32.390729 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6801452-76d6-471b-bc16-2fe5df9044b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:32.390729 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6801452-76d6-471b-bc16-2fe5df9044b7 None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:32.390729 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6801452-76d6-471b-bc16-2fe5df9044b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:32.390729 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6801452-76d6-471b-bc16-2fe5df9044b7 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:32.391047 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199586f5-3f8c-4003-89f5-c898bc65d2a4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kQJC0lhBS2a9hoWQl9fwcw, audit_chain_id=['kQJC0lhBS2a9hoWQl9fwcw']) at 0x7f8a0fd83190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:32.392409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:32.392560 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199586f5-3f8c-4003-89f5-c898bc65d2a4 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:32.392560 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199586f5-3f8c-4003-89f5-c898bc65d2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:32.392560 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199586f5-3f8c-4003-89f5-c898bc65d2a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:32.401901 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 359/715] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Jul 25 22:48:32 2022] GET /identity/v3/services => generated 1002 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:48:32.403937 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199586f5-3f8c-4003-89f5-c898bc65d2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:32.405452 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199586f5-3f8c-4003-89f5-c898bc65d2a4 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:32.422573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-199586f5-3f8c-4003-89f5-c898bc65d2a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:32.422573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:32.422573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:32.422573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:32.422573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:32.422573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:32.422573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:32.422573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:32.422573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:32.422573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:32.422573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:32.422573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:32.422573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:32.422573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:32.422573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:32.423558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:32.423558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:32.423558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:32.423558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:32.423558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:32.423558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:32.423558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:32.423558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:32.423558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:32.423558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:32.423558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:32.423558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:32.423558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:32.423558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:32.423558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:32.423558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:32.423558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:32.424447 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:32.424447 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:32.424447 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:32.424447 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:32.424447 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 357/716] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:32.430044 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6801452-76d6-471b-bc16-2fe5df9044b7 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:32.561612 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6801452-76d6-471b-bc16-2fe5df9044b7 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:32.599673 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38e254-d22b-4b86-87e2-110614dd9da4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kQJC0lhBS2a9hoWQl9fwcw, audit_chain_id=['kQJC0lhBS2a9hoWQl9fwcw']) at 0x7f8a0fd820a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:32.600301 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38e254-d22b-4b86-87e2-110614dd9da4 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:32.600585 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38e254-d22b-4b86-87e2-110614dd9da4 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:32.600863 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38e254-d22b-4b86-87e2-110614dd9da4 None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:32.601560 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38e254-d22b-4b86-87e2-110614dd9da4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:32.601903 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38e254-d22b-4b86-87e2-110614dd9da4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:32.603344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38e254-d22b-4b86-87e2-110614dd9da4 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:32.617018 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 360/717] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:32.623354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199586f5-3f8c-4003-89f5-c898bc65d2a4 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:32.737327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199586f5-3f8c-4003-89f5-c898bc65d2a4 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:32.751847 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:32.777118 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccd27e-166f-4096-8cdd-8a190b60c143 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kQJC0lhBS2a9hoWQl9fwcw, audit_chain_id=['kQJC0lhBS2a9hoWQl9fwcw']) at 0x7f8a0fc619a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:32.778135 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccd27e-166f-4096-8cdd-8a190b60c143 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:32.778595 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccd27e-166f-4096-8cdd-8a190b60c143 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:32.779101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccd27e-166f-4096-8cdd-8a190b60c143 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:32.787457 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccd27e-166f-4096-8cdd-8a190b60c143 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:32.789167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ccd27e-166f-4096-8cdd-8a190b60c143 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:32.801557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-72ccd27e-166f-4096-8cdd-8a190b60c143 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:48:32.801557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:32.801557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:32.801557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:32.801557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:32.801557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:32.801557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:32.801557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:32.801557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:32.801557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:32.801557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:32.801557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:32.801557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:32.801557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:32.801557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:32.801557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:32.802551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:32.802551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:32.802551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:32.802551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:32.802551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:32.802551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:32.802551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:32.802551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:32.802551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:32.802551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:32.802551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:32.802551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:32.802551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:32.802551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:32.802551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:32.802551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:32.802551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:32.802551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:32.803516 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:32.803516 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:32.803516 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:32.803516 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:32.803516 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:32.803516 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:32.803516 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:32.803516 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:32.803516 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:48:32.803516 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:32.805941 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 358/718] 10.222.0.47 () {56 vars in 1093 bytes} [Mon Jul 25 22:48:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:32.813787 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38e254-d22b-4b86-87e2-110614dd9da4 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:32.875489 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:32.922642 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38e254-d22b-4b86-87e2-110614dd9da4 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:32.959000 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7598b72-a34e-4ad4-9272-8e44a810d799 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kQJC0lhBS2a9hoWQl9fwcw, audit_chain_id=['kQJC0lhBS2a9hoWQl9fwcw']) at 0x7f8a0fe14ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:32.959866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7598b72-a34e-4ad4-9272-8e44a810d799 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:32.960295 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7598b72-a34e-4ad4-9272-8e44a810d799 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:32.960798 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7598b72-a34e-4ad4-9272-8e44a810d799 None admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:32.961764 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7598b72-a34e-4ad4-9272-8e44a810d799 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:32.962900 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7598b72-a34e-4ad4-9272-8e44a810d799 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:32.964761 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7598b72-a34e-4ad4-9272-8e44a810d799 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:32.983721 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 361/719] 10.222.0.47 () {56 vars in 1133 bytes} [Mon Jul 25 22:48:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:32.989667 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccd27e-166f-4096-8cdd-8a190b60c143 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:33.116358 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccd27e-166f-4096-8cdd-8a190b60c143 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:33.153863 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1358365-53c8-4080-9383-08194b0f0ea4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kQJC0lhBS2a9hoWQl9fwcw, audit_chain_id=['kQJC0lhBS2a9hoWQl9fwcw']) at 0x7f8a0fd0c0a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:33.154488 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1358365-53c8-4080-9383-08194b0f0ea4 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:33.154770 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1358365-53c8-4080-9383-08194b0f0ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:33.155042 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1358365-53c8-4080-9383-08194b0f0ea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:33.198959 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:33.208971 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b9584-218f-4a8f-9736-08dc22215053 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:33.209557 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b9584-218f-4a8f-9736-08dc22215053 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:33.210083 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b9584-218f-4a8f-9736-08dc22215053 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:33.211838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 362/720] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:33.217900 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c078d4e-4dfc-4746-9520-13df803d2eed None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:33.218443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c078d4e-4dfc-4746-9520-13df803d2eed None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:33.218920 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c078d4e-4dfc-4746-9520-13df803d2eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:33.227547 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1358365-53c8-4080-9383-08194b0f0ea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:33.229375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1358365-53c8-4080-9383-08194b0f0ea4 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:33.238990 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-2c078d4e-4dfc-4746-9520-13df803d2eed None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:33.240606 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-2c078d4e-4dfc-4746-9520-13df803d2eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:33.322122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 363/721] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:33 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:33.341354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 359/722] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:48:32 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:48:33.348480 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c078d4e-4dfc-4746-9520-13df803d2eed None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:33.348632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1358365-53c8-4080-9383-08194b0f0ea4 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:33.397624 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:33.423070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:33.454729 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c078d4e-4dfc-4746-9520-13df803d2eed None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:33.456342 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1358365-53c8-4080-9383-08194b0f0ea4 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:33.494482 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37690668-f939-4b24-9412-c603fd16a23b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UsAQEdK9QAGRptxAS3kDCQ, audit_chain_id=['UsAQEdK9QAGRptxAS3kDCQ']) at 0x7f8a0fe07130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:33.495429 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690668-f939-4b24-9412-c603fd16a23b None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:33.495635 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ade6dd-793a-488c-9b5e-f711c5cd3c17 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kQJC0lhBS2a9hoWQl9fwcw, audit_chain_id=['kQJC0lhBS2a9hoWQl9fwcw']) at 0x7f8a0fd0cee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:33.496157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690668-f939-4b24-9412-c603fd16a23b None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:33.496264 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ade6dd-793a-488c-9b5e-f711c5cd3c17 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:33.496550 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ade6dd-793a-488c-9b5e-f711c5cd3c17 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:33.496824 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ade6dd-793a-488c-9b5e-f711c5cd3c17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:33.497308 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37690668-f939-4b24-9412-c603fd16a23b None admin] PATH_INFO: `/v3/services/image` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:33.498219 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37690668-f939-4b24-9412-c603fd16a23b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:33.499783 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37690668-f939-4b24-9412-c603fd16a23b None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:33.507754 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ade6dd-793a-488c-9b5e-f711c5cd3c17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:33.509882 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ade6dd-793a-488c-9b5e-f711c5cd3c17 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:33.512240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-37690668-f939-4b24-9412-c603fd16a23b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:48:33.512240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:33.512240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:33.512240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:33.512240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:33.512240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:33.512240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:33.512240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:33.512240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:48:33.512240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:33.512240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:33.512240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:33.512240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:33.512240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:33.512240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:33.512240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:33.512240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:33.513232 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:33.513232 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:33.513232 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:33.513232 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:33.513232 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:33.513232 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:33.513232 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:33.513232 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:33.513232 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:33.513232 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:33.513232 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:33.513232 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:33.513232 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:33.513232 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:33.513232 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:33.513232 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:33.514115 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:33.514115 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:33.514115 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:33.514115 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:33.514115 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:33.514115 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:33.514115 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:33.514115 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:33.514115 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:33.514115 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:33.514115 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:33.514115 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:33.514115 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:48:33.514115 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:33.517135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 364/723] 10.222.0.47 () {56 vars in 1105 bytes} [Mon Jul 25 22:48:33 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:48:33.523442 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37690668-f939-4b24-9412-c603fd16a23b None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:33.533996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-89ade6dd-793a-488c-9b5e-f711c5cd3c17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:33.533996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:33.533996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:33.533996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:33.533996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:33.533996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:33.533996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:33.533996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:33.533996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:33.533996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:33.533996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:33.533996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:33.533996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:33.533996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:33.533996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:33.535077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:33.535077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:33.535077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:33.535077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:33.535077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:33.535077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:33.535077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:33.535077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:33.535077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:33.535077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:33.535077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:33.535077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:33.535077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:33.535077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:33.535077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:33.535077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:33.535077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:33.536158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:33.536158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:33.536158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:33.536158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:33.538151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 360/724] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:48:33.544233 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ade6dd-793a-488c-9b5e-f711c5cd3c17 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:33.651033 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37690668-f939-4b24-9412-c603fd16a23b None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:33.664791 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:33.667055 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ade6dd-793a-488c-9b5e-f711c5cd3c17 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:33.689748 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586ea50-84cc-4cdf-b142-240a34f2873a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UsAQEdK9QAGRptxAS3kDCQ, audit_chain_id=['UsAQEdK9QAGRptxAS3kDCQ']) at 0x7f8a0fccbbe0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:33.690383 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586ea50-84cc-4cdf-b142-240a34f2873a None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:33.690662 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586ea50-84cc-4cdf-b142-240a34f2873a None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:33.690962 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586ea50-84cc-4cdf-b142-240a34f2873a None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:33.691621 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586ea50-84cc-4cdf-b142-240a34f2873a None admin] RBAC: Adding query filter params (name=image) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:33.691928 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586ea50-84cc-4cdf-b142-240a34f2873a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:33.693380 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586ea50-84cc-4cdf-b142-240a34f2873a None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:33.693922 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:33.699620 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 365/725] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:33.706437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586ea50-84cc-4cdf-b142-240a34f2873a None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:33.709136 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c89d63-74e5-4e32-a263-4dedd0811c64 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kQJC0lhBS2a9hoWQl9fwcw, audit_chain_id=['kQJC0lhBS2a9hoWQl9fwcw']) at 0x7f8a0fd83a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:33.710012 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c89d63-74e5-4e32-a263-4dedd0811c64 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:33.710497 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c89d63-74e5-4e32-a263-4dedd0811c64 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:33.710977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c89d63-74e5-4e32-a263-4dedd0811c64 None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:33.711904 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c89d63-74e5-4e32-a263-4dedd0811c64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:33.713127 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c89d63-74e5-4e32-a263-4dedd0811c64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:33.715000 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c89d63-74e5-4e32-a263-4dedd0811c64 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:33.728174 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 361/726] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:33.733669 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c89d63-74e5-4e32-a263-4dedd0811c64 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:33.826742 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586ea50-84cc-4cdf-b142-240a34f2873a None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:33.839746 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c89d63-74e5-4e32-a263-4dedd0811c64 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:33.864563 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cab42-1499-4b81-a34d-0d251ab6c45d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UsAQEdK9QAGRptxAS3kDCQ, audit_chain_id=['UsAQEdK9QAGRptxAS3kDCQ']) at 0x7f8a0fcd8490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:33.865193 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cab42-1499-4b81-a34d-0d251ab6c45d None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:33.865478 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cab42-1499-4b81-a34d-0d251ab6c45d None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:33.865844 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53cab42-1499-4b81-a34d-0d251ab6c45d None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:33.866624 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cab42-1499-4b81-a34d-0d251ab6c45d None admin] RBAC: Adding query filter params (type=image) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:33.867063 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cab42-1499-4b81-a34d-0d251ab6c45d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:33.869183 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53cab42-1499-4b81-a34d-0d251ab6c45d None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:33.878711 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d660c-31e9-4a1d-8b95-6b5ff30254ca None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kQJC0lhBS2a9hoWQl9fwcw, audit_chain_id=['kQJC0lhBS2a9hoWQl9fwcw']) at 0x7f8a0fc615e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:33.879511 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 366/727] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:33.880071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d660c-31e9-4a1d-8b95-6b5ff30254ca None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:33.880340 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cab42-1499-4b81-a34d-0d251ab6c45d None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:33.880749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d660c-31e9-4a1d-8b95-6b5ff30254ca None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:33.881211 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d660c-31e9-4a1d-8b95-6b5ff30254ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:33.888865 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d660c-31e9-4a1d-8b95-6b5ff30254ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:33.890965 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d660c-31e9-4a1d-8b95-6b5ff30254ca None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:33.903061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-3b9d660c-31e9-4a1d-8b95-6b5ff30254ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:33.903061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:33.903061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:33.903061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:33.903061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:33.903061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:33.903061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:33.903061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:33.903061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:33.903061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:33.903061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:33.903061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:33.903061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:33.903061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:33.903061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:33.903978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:33.903978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:33.903978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:33.903978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:33.903978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:33.903978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:33.903978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:33.903978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:33.903978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:33.903978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:33.903978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:33.903978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:33.903978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:33.903978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:33.903978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:33.903978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:33.903978 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:33.904922 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:33.904922 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:33.904922 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:33.904922 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:33.904922 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:33.904922 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:33.904922 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:33.904922 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:33.907467 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 362/728] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:33.913298 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d660c-31e9-4a1d-8b95-6b5ff30254ca None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:33.932936 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:33.966738 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:33.998735 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53cab42-1499-4b81-a34d-0d251ab6c45d None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:34.032328 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d660c-31e9-4a1d-8b95-6b5ff30254ca None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:34.037305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe1b7d-0f3d-4828-b7d8-1231cf55bbc6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UsAQEdK9QAGRptxAS3kDCQ, audit_chain_id=['UsAQEdK9QAGRptxAS3kDCQ']) at 0x7f8a0fd29880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:34.037981 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe1b7d-0f3d-4828-b7d8-1231cf55bbc6 None admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:34.038266 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe1b7d-0f3d-4828-b7d8-1231cf55bbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:34.038543 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe1b7d-0f3d-4828-b7d8-1231cf55bbc6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:34.039358 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe1b7d-0f3d-4828-b7d8-1231cf55bbc6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:34.041000 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe1b7d-0f3d-4828-b7d8-1231cf55bbc6 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:34.078072 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 367/729] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 22:48:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:48:34.085043 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9e228-bc78-46a2-a9f8-98f331aec8cb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kQJC0lhBS2a9hoWQl9fwcw, audit_chain_id=['kQJC0lhBS2a9hoWQl9fwcw']) at 0x7f8a0fc64c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:34.086124 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9e228-bc78-46a2-a9f8-98f331aec8cb None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:34.086613 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9e228-bc78-46a2-a9f8-98f331aec8cb None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:34.087118 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9e228-bc78-46a2-a9f8-98f331aec8cb None admin] PATH_INFO: `/v3/projects` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:34.089081 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9e228-bc78-46a2-a9f8-98f331aec8cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:34.089649 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9e228-bc78-46a2-a9f8-98f331aec8cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:34.091473 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9e228-bc78-46a2-a9f8-98f331aec8cb None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:34.106716 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 363/730] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:48:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:34.114153 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe1b7d-0f3d-4828-b7d8-1231cf55bbc6 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:34.215749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2667d-5a86-4b62-8ab6-7ca54801b42c None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:34.216397 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2667d-5a86-4b62-8ab6-7ca54801b42c None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:34.216878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2667d-5a86-4b62-8ab6-7ca54801b42c None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:34.219074 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 364/731] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:48:34.224449 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f2cdd-e1fd-4f90-bd24-6675f8e1c284 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:34.224737 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f2cdd-e1fd-4f90-bd24-6675f8e1c284 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:34.225015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f2cdd-e1fd-4f90-bd24-6675f8e1c284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:34.229868 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:34.237975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe1b7d-0f3d-4828-b7d8-1231cf55bbc6 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:34.250736 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-eb1f2cdd-e1fd-4f90-bd24-6675f8e1c284 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:34.252523 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-eb1f2cdd-e1fd-4f90-bd24-6675f8e1c284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:34.292269 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a5e35-ea85-4e4d-b168-71f1d16f5cec None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kQJC0lhBS2a9hoWQl9fwcw, audit_chain_id=['kQJC0lhBS2a9hoWQl9fwcw']) at 0x7f8a0fd29460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:34.293041 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a5e35-ea85-4e4d-b168-71f1d16f5cec None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:34.293327 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a5e35-ea85-4e4d-b168-71f1d16f5cec None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:34.293640 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a5e35-ea85-4e4d-b168-71f1d16f5cec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:34.294938 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a5e35-ea85-4e4d-b168-71f1d16f5cec None admin] RBAC: Adding query filter params (role.id=6ca03befbf3a456eae350bc7e583488f, scope.project.id=2d1b44363d694c60867ec29af4f9d01e, user.id=a2528d7506a5481f8fa6bb5012b4a9dd) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:34.295262 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a5e35-ea85-4e4d-b168-71f1d16f5cec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:34.296954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a5e35-ea85-4e4d-b168-71f1d16f5cec None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:34.304018 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 368/732] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:48:34 2022] GET /identity/v3/role_assignments?user.id=a2528d7506a5481f8fa6bb5012b4a9dd&scope.project.id=2d1b44363d694c60867ec29af4f9d01e&role.id=6ca03befbf3a456eae350bc7e583488f => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:34.348399 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 365/733] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:34 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:48:34.373165 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a5e35-ea85-4e4d-b168-71f1d16f5cec None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:34.491363 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a5e35-ea85-4e4d-b168-71f1d16f5cec None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:34.529421 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba91fa-245c-48b8-812f-1570c150406e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=S0auNzxuRLKFrqR1dTmqFQ, audit_chain_id=['S0auNzxuRLKFrqR1dTmqFQ']) at 0x7f8a0fdff1c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:34.530097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba91fa-245c-48b8-812f-1570c150406e None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:34.530378 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba91fa-245c-48b8-812f-1570c150406e None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:34.530648 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba91fa-245c-48b8-812f-1570c150406e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:34.531272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba91fa-245c-48b8-812f-1570c150406e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:34.532632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba91fa-245c-48b8-812f-1570c150406e None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:34.543281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-2bba91fa-245c-48b8-812f-1570c150406e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:48:34.543281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:34.543281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:34.543281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:34.543281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:34.543281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:34.543281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:34.543281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:34.543281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:48:34.543281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:34.543281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:34.543281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:34.543281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:34.543281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:34.543281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:34.543281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:34.544264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:34.544264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:34.544264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:34.544264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:34.544264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:34.544264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:34.544264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:34.544264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:34.544264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:34.544264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:34.544264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:34.544264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:34.544264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:34.544264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:34.544264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:34.544264 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:34.545097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:34.545097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:34.545097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:34.545097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:34.545097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:34.545097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:34.545097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:34.545097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:34.545097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:34.545097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:34.545097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:34.545097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:34.545097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:34.545097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:48:34.545097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:34.545097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 369/734] 10.222.0.47 () {56 vars in 1129 bytes} [Mon Jul 25 22:48:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:34.552529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f2cdd-e1fd-4f90-bd24-6675f8e1c284 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:34.591789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:34.673408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f2cdd-e1fd-4f90-bd24-6675f8e1c284 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:34.709773 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3350e-1cac-4e4d-b12c-887bb9d841fa None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=S0auNzxuRLKFrqR1dTmqFQ, audit_chain_id=['S0auNzxuRLKFrqR1dTmqFQ']) at 0x7f8a0fd0c9d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:34.710809 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3350e-1cac-4e4d-b12c-887bb9d841fa None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:34.711311 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3350e-1cac-4e4d-b12c-887bb9d841fa None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:34.711790 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3350e-1cac-4e4d-b12c-887bb9d841fa None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:34.712858 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3350e-1cac-4e4d-b12c-887bb9d841fa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:34.713369 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3350e-1cac-4e4d-b12c-887bb9d841fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:34.714957 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3350e-1cac-4e4d-b12c-887bb9d841fa None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:34.720360 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 366/735] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Jul 25 22:48:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:34.726149 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba91fa-245c-48b8-812f-1570c150406e None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:34.755158 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:34.778006 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8258d-e514-46cf-b91e-66ce03302117 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:34.778340 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8258d-e514-46cf-b91e-66ce03302117 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:34.778575 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8258d-e514-46cf-b91e-66ce03302117 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:34.780154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 367/736] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:34.785227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4c36e-9d33-487f-ad14-c6a6d84f0aed None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:34.785355 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4c36e-9d33-487f-ad14-c6a6d84f0aed None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:34.785618 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4c36e-9d33-487f-ad14-c6a6d84f0aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:34.804963 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-01d4c36e-9d33-487f-ad14-c6a6d84f0aed None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:34.807284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-01d4c36e-9d33-487f-ad14-c6a6d84f0aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:34.850005 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba91fa-245c-48b8-812f-1570c150406e None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:34.886847 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 368/737] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:34 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:34.898516 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0029d-05ac-44ea-aab3-8bc3f8ebc8d1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=S0auNzxuRLKFrqR1dTmqFQ, audit_chain_id=['S0auNzxuRLKFrqR1dTmqFQ']) at 0x7f8a0fdc2430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:34.899146 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0029d-05ac-44ea-aab3-8bc3f8ebc8d1 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:34.899429 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0029d-05ac-44ea-aab3-8bc3f8ebc8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:34.899750 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0029d-05ac-44ea-aab3-8bc3f8ebc8d1 None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:34.900786 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0029d-05ac-44ea-aab3-8bc3f8ebc8d1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:34.901149 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0029d-05ac-44ea-aab3-8bc3f8ebc8d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:34.902548 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0029d-05ac-44ea-aab3-8bc3f8ebc8d1 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:34.908560 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 370/738] 10.222.0.47 () {56 vars in 1124 bytes} [Mon Jul 25 22:48:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:34.914059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4c36e-9d33-487f-ad14-c6a6d84f0aed None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:34.914190 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0029d-05ac-44ea-aab3-8bc3f8ebc8d1 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:34.949908 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:35.013887 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:35.032679 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0029d-05ac-44ea-aab3-8bc3f8ebc8d1 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:35.043612 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4c36e-9d33-487f-ad14-c6a6d84f0aed None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:35.080479 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2fcd4-867e-451a-b27f-2034736889be None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Of9RfOhSTt-QnUWgzCoI7w, audit_chain_id=['Of9RfOhSTt-QnUWgzCoI7w']) at 0x7f8a0fffca60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:35.080676 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed4191-4761-4732-bc32-150daebfe6a7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=S0auNzxuRLKFrqR1dTmqFQ, audit_chain_id=['S0auNzxuRLKFrqR1dTmqFQ']) at 0x7f8a0fdd0250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:35.081137 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2fcd4-867e-451a-b27f-2034736889be None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:35.081265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed4191-4761-4732-bc32-150daebfe6a7 None admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:35.081432 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2fcd4-867e-451a-b27f-2034736889be None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:35.081525 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed4191-4761-4732-bc32-150daebfe6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:35.081754 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2fcd4-867e-451a-b27f-2034736889be None admin] PATH_INFO: `/v3/services/network` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:35.081856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed4191-4761-4732-bc32-150daebfe6a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:35.082379 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2fcd4-867e-451a-b27f-2034736889be None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:35.082482 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed4191-4761-4732-bc32-150daebfe6a7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:35.083762 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2fcd4-867e-451a-b27f-2034736889be None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:35.083875 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed4191-4761-4732-bc32-150daebfe6a7 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:35.095396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-5ae2fcd4-867e-451a-b27f-2034736889be None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:48:35.095396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:35.095396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:35.095396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:35.095396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:35.095396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:35.095396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:35.095396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:35.095396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:48:35.095396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:35.095396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:35.095396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:35.095396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:35.095396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:35.095396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:35.095396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:35.095396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:35.096429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:35.096429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:35.096429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:35.096429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:35.096429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:35.096429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:35.096429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:35.096429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:35.096429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:35.096429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:35.096429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:35.096429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:35.096429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:35.096429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:35.096429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:35.096429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:35.097338 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:35.097338 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:35.097338 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:35.097338 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:35.097338 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:35.097338 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:35.097338 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:35.097338 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:35.097338 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:35.097338 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:35.097338 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:35.097338 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:35.097338 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:48:35.097338 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:35.101702 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 369/739] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:34 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:35.103338 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2fcd4-867e-451a-b27f-2034736889be None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:35.114553 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 371/740] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 22:48:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:48:35.212959 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:35.231353 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2fcd4-867e-451a-b27f-2034736889be None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:35.278226 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bde22-7b1f-4acb-b69f-7d138922e69e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Of9RfOhSTt-QnUWgzCoI7w, audit_chain_id=['Of9RfOhSTt-QnUWgzCoI7w']) at 0x7f8a0fca7100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:35.278864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bde22-7b1f-4acb-b69f-7d138922e69e None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:35.279146 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bde22-7b1f-4acb-b69f-7d138922e69e None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:35.279427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bde22-7b1f-4acb-b69f-7d138922e69e None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:35.280107 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bde22-7b1f-4acb-b69f-7d138922e69e None admin] RBAC: Adding query filter params (name=network) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:35.280411 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bde22-7b1f-4acb-b69f-7d138922e69e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:35.281845 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bde22-7b1f-4acb-b69f-7d138922e69e None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:35.287239 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 370/741] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 22:48:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:35.292505 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed4191-4761-4732-bc32-150daebfe6a7 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:35.406393 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed4191-4761-4732-bc32-150daebfe6a7 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:35.443143 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f6f24-1ef2-4c73-9861-ad2cf9eecccc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Of9RfOhSTt-QnUWgzCoI7w, audit_chain_id=['Of9RfOhSTt-QnUWgzCoI7w']) at 0x7f8a14cf47f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:35.443777 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f6f24-1ef2-4c73-9861-ad2cf9eecccc None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:35.444056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f6f24-1ef2-4c73-9861-ad2cf9eecccc None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:35.444328 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f6f24-1ef2-4c73-9861-ad2cf9eecccc None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:35.444996 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f6f24-1ef2-4c73-9861-ad2cf9eecccc None admin] RBAC: Adding query filter params (type=network) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:35.445298 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f6f24-1ef2-4c73-9861-ad2cf9eecccc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:35.446796 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f6f24-1ef2-4c73-9861-ad2cf9eecccc None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:35.452597 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 372/742] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 22:48:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:35.458254 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bde22-7b1f-4acb-b69f-7d138922e69e None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:35.569127 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bde22-7b1f-4acb-b69f-7d138922e69e None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:35.611143 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b38366-1bcc-4ce4-a8cf-d5174aac2a12 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Of9RfOhSTt-QnUWgzCoI7w, audit_chain_id=['Of9RfOhSTt-QnUWgzCoI7w']) at 0x7f8a0fc9fd90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:35.613609 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b38366-1bcc-4ce4-a8cf-d5174aac2a12 None admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:35.613609 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b38366-1bcc-4ce4-a8cf-d5174aac2a12 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:35.613609 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b38366-1bcc-4ce4-a8cf-d5174aac2a12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:35.613609 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b38366-1bcc-4ce4-a8cf-d5174aac2a12 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:35.614372 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b38366-1bcc-4ce4-a8cf-d5174aac2a12 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:35.639380 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 371/743] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 22:48:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:48:36.460111 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e4eb2-a6b5-474e-bee7-903de798db9f None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:36.460653 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e4eb2-a6b5-474e-bee7-903de798db9f None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:36.460653 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e4eb2-a6b5-474e-bee7-903de798db9f None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:36.462701 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 373/744] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:36.467910 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80238bc-b3d2-4f44-8b9f-f6f71e72f08f None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:36.468301 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80238bc-b3d2-4f44-8b9f-f6f71e72f08f None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:36.468477 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80238bc-b3d2-4f44-8b9f-f6f71e72f08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:36.477441 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:36.490569 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-b80238bc-b3d2-4f44-8b9f-f6f71e72f08f None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:36.491801 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-b80238bc-b3d2-4f44-8b9f-f6f71e72f08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:36.567415 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 372/745] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:36 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:36.595474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e4eb2-a6b5-474e-bee7-903de798db9f None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:36.608404 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:36.702980 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e4eb2-a6b5-474e-bee7-903de798db9f None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:36.735745 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94c84c-e955-4c97-985f-e2f95f263f04 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:36.735985 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94c84c-e955-4c97-985f-e2f95f263f04 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:36.736222 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94c84c-e955-4c97-985f-e2f95f263f04 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:36.737786 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 373/746] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:48:36.737894 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1051acd-1dda-44c0-8bbb-4078aa3e79d4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L8WrxcqVTn2JYITrlEwRwQ, audit_chain_id=['L8WrxcqVTn2JYITrlEwRwQ']) at 0x7f8a0fd64460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:36.738370 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1051acd-1dda-44c0-8bbb-4078aa3e79d4 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:36.738680 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1051acd-1dda-44c0-8bbb-4078aa3e79d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:36.738923 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1051acd-1dda-44c0-8bbb-4078aa3e79d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:36.742595 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fa212-9921-42e5-b646-fe9b7d932ec2 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:36.742882 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fa212-9921-42e5-b646-fe9b7d932ec2 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:36.743217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fa212-9921-42e5-b646-fe9b7d932ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:36.761404 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-345fa212-9921-42e5-b646-fe9b7d932ec2 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:36.762615 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-345fa212-9921-42e5-b646-fe9b7d932ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:36.810512 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1051acd-1dda-44c0-8bbb-4078aa3e79d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:36.811961 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1051acd-1dda-44c0-8bbb-4078aa3e79d4 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:36.822751 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:36.838219 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 374/747] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:36 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:48:36.857969 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fa212-9921-42e5-b646-fe9b7d932ec2 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:36.922875 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:36.931009 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 374/748] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:48:36 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:48:36.932036 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1051acd-1dda-44c0-8bbb-4078aa3e79d4 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:36.968226 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fa212-9921-42e5-b646-fe9b7d932ec2 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:37.004413 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407e31f-859c-4d1e-bda8-0cf02ab21f2f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QuXNSBsGQFKpY_bZIU9SdQ, audit_chain_id=['QuXNSBsGQFKpY_bZIU9SdQ']) at 0x7f8a0fdcffd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:37.005390 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407e31f-859c-4d1e-bda8-0cf02ab21f2f None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:37.005882 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407e31f-859c-4d1e-bda8-0cf02ab21f2f None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:37.006337 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407e31f-859c-4d1e-bda8-0cf02ab21f2f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:37.007156 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407e31f-859c-4d1e-bda8-0cf02ab21f2f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:37.008597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407e31f-859c-4d1e-bda8-0cf02ab21f2f None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:37.019001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-b407e31f-859c-4d1e-bda8-0cf02ab21f2f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:48:37.019001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:37.019001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:37.019001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:37.019001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:37.019001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:37.019001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:37.019001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:37.019001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:48:37.019001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:37.019001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:37.019001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:37.019001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:37.019001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:37.019001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:37.019001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:37.020167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:37.020167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:37.020167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:37.020167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:37.020167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:37.020167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:37.020167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:37.020167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:37.020167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:37.020167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:37.020167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:37.020167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:37.020167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:37.020167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:37.020167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:37.020167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:37.021015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:37.021015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:37.021015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:37.021015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:37.021015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:37.021015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:37.021015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:37.021015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:37.021015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:37.021015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:37.021015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:37.021015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:37.021015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:37.021015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:48:37.021015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:37.021015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 375/749] 10.222.0.47 () {56 vars in 1132 bytes} [Mon Jul 25 22:48:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:48:37.027009 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407e31f-859c-4d1e-bda8-0cf02ab21f2f None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:37.045030 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1051acd-1dda-44c0-8bbb-4078aa3e79d4 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:37.058157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:37.090470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b297106-bc78-4d9a-986e-3519df80059a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L8WrxcqVTn2JYITrlEwRwQ, audit_chain_id=['L8WrxcqVTn2JYITrlEwRwQ']) at 0x7f8a0fe3ab50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:37.091237 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b297106-bc78-4d9a-986e-3519df80059a None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:37.091526 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b297106-bc78-4d9a-986e-3519df80059a None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:37.092079 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b297106-bc78-4d9a-986e-3519df80059a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:37.102990 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b297106-bc78-4d9a-986e-3519df80059a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:37.104529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b297106-bc78-4d9a-986e-3519df80059a None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:37.132312 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407e31f-859c-4d1e-bda8-0cf02ab21f2f None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:37.139993 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-7b297106-bc78-4d9a-986e-3519df80059a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:37.139993 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:37.139993 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:37.139993 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:37.139993 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:37.139993 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:37.139993 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:37.139993 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:37.139993 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:37.139993 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:37.139993 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:37.139993 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:37.139993 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:48:37.139993 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:48:37.139993 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:48:37.140910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:48:37.140910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:37.140910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:37.140910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:37.140910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:37.140910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:37.140910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:37.140910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:37.140910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:37.140910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:37.140910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:37.140910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:37.140910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:37.140910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:37.140910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:37.140910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:37.140910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:37.141849 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:48:37.141849 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:48:37.141849 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:48:37.141849 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:37.141849 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 375/750] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:48:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:37.147412 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b297106-bc78-4d9a-986e-3519df80059a None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:37.159937 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:37.171723 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d130f0-77c9-40b5-8b47-9d7a241e3f20 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QuXNSBsGQFKpY_bZIU9SdQ, audit_chain_id=['QuXNSBsGQFKpY_bZIU9SdQ']) at 0x7f8a0fc023d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:37.172438 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d130f0-77c9-40b5-8b47-9d7a241e3f20 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:37.172725 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d130f0-77c9-40b5-8b47-9d7a241e3f20 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:37.173002 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d130f0-77c9-40b5-8b47-9d7a241e3f20 None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:37.173708 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d130f0-77c9-40b5-8b47-9d7a241e3f20 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:37.174017 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d130f0-77c9-40b5-8b47-9d7a241e3f20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:37.175391 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d130f0-77c9-40b5-8b47-9d7a241e3f20 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:37.180315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 376/751] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Jul 25 22:48:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:37.186288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d130f0-77c9-40b5-8b47-9d7a241e3f20 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:37.256692 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b297106-bc78-4d9a-986e-3519df80059a None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:37.294581 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d130f0-77c9-40b5-8b47-9d7a241e3f20 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:37.299650 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7035b1-5aea-4a2b-a104-c4001c64e295 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L8WrxcqVTn2JYITrlEwRwQ, audit_chain_id=['L8WrxcqVTn2JYITrlEwRwQ']) at 0x7f8a0fcb2670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:37.300284 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7035b1-5aea-4a2b-a104-c4001c64e295 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:37.300568 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7035b1-5aea-4a2b-a104-c4001c64e295 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:37.300842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7035b1-5aea-4a2b-a104-c4001c64e295 None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:37.301537 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7035b1-5aea-4a2b-a104-c4001c64e295 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:37.301873 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7035b1-5aea-4a2b-a104-c4001c64e295 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:37.303806 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7035b1-5aea-4a2b-a104-c4001c64e295 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:37.329604 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 376/752] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:37.332866 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc8134-9442-40fb-bf41-1d7a24dbc9f7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QuXNSBsGQFKpY_bZIU9SdQ, audit_chain_id=['QuXNSBsGQFKpY_bZIU9SdQ']) at 0x7f8a0fe5b190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:37.333522 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc8134-9442-40fb-bf41-1d7a24dbc9f7 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:37.333860 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc8134-9442-40fb-bf41-1d7a24dbc9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:37.334142 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc8134-9442-40fb-bf41-1d7a24dbc9f7 None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:37.334844 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc8134-9442-40fb-bf41-1d7a24dbc9f7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:37.335152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc8134-9442-40fb-bf41-1d7a24dbc9f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:37.336584 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc8134-9442-40fb-bf41-1d7a24dbc9f7 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:37.345631 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 377/753] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Jul 25 22:48:37 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:37.439502 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42914738-801c-4ab6-b1f5-fb5ef3de7ae8 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:37.439843 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42914738-801c-4ab6-b1f5-fb5ef3de7ae8 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:37.440065 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42914738-801c-4ab6-b1f5-fb5ef3de7ae8 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:37.441688 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 377/754] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:37.448574 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f80ba-a1fe-4ce5-a66e-97fbf49d309f None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:37.448924 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f80ba-a1fe-4ce5-a66e-97fbf49d309f None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:37.449137 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f80ba-a1fe-4ce5-a66e-97fbf49d309f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:37.471353 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-eb1f80ba-a1fe-4ce5-a66e-97fbf49d309f None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:37.473346 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-eb1f80ba-a1fe-4ce5-a66e-97fbf49d309f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:37.533972 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:37.556613 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 378/755] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:37 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:37.579118 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42914738-801c-4ab6-b1f5-fb5ef3de7ae8 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:37.607893 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:37.694577 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42914738-801c-4ab6-b1f5-fb5ef3de7ae8 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:37.728919 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6e75a-8afb-4be1-bf9d-184bc2ebdc23 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lY8tY1joQ5OeJx9m3-vceg, audit_chain_id=['lY8tY1joQ5OeJx9m3-vceg']) at 0x7f8a0fd320a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:37.729563 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6e75a-8afb-4be1-bf9d-184bc2ebdc23 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:37.729872 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6e75a-8afb-4be1-bf9d-184bc2ebdc23 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:37.730151 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6e75a-8afb-4be1-bf9d-184bc2ebdc23 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:37.730777 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6e75a-8afb-4be1-bf9d-184bc2ebdc23 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:37.732148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6e75a-8afb-4be1-bf9d-184bc2ebdc23 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:37.740825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-87c6e75a-8afb-4be1-bf9d-184bc2ebdc23 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:48:37.740825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:37.740825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:37.740825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:37.740825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:37.740825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:37.740825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:37.740825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:37.740825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:48:37.740825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:37.740825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:37.740825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:37.740825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:37.740825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:37.740825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:37.740825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:37.740825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:37.741822 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:37.741822 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:37.741822 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:37.741822 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:37.741822 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:37.741822 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:37.741822 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:37.741822 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:37.741822 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:37.741822 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:37.741822 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:37.741822 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:37.741822 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:37.741822 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:37.741822 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:37.741822 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:37.742659 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:37.742659 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:37.742659 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:37.742659 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:37.742659 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:37.742659 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:37.742659 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:37.742659 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:37.742659 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:37.742659 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:37.742659 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:37.742659 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:37.742659 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:48:37.742659 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:37.742659 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 378/756] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:48:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:37.748008 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f80ba-a1fe-4ce5-a66e-97fbf49d309f None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:37.847104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f80ba-a1fe-4ce5-a66e-97fbf49d309f None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:37.881233 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739af73f-48e3-4a95-a54e-2d851fa1e8b4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lY8tY1joQ5OeJx9m3-vceg, audit_chain_id=['lY8tY1joQ5OeJx9m3-vceg']) at 0x7f8a0fdd9400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:37.881894 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739af73f-48e3-4a95-a54e-2d851fa1e8b4 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:37.882254 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739af73f-48e3-4a95-a54e-2d851fa1e8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:37.882460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739af73f-48e3-4a95-a54e-2d851fa1e8b4 None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:37.883134 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739af73f-48e3-4a95-a54e-2d851fa1e8b4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:37.883440 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739af73f-48e3-4a95-a54e-2d851fa1e8b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:37.885516 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739af73f-48e3-4a95-a54e-2d851fa1e8b4 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:37.890357 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 379/757] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:48:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:37.895946 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6e75a-8afb-4be1-bf9d-184bc2ebdc23 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:37.980049 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:37.997604 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6e75a-8afb-4be1-bf9d-184bc2ebdc23 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:38.031944 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabe2de-f1ce-4738-ba12-5891e91a1044 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lY8tY1joQ5OeJx9m3-vceg, audit_chain_id=['lY8tY1joQ5OeJx9m3-vceg']) at 0x7f8a0fc49c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:38.032565 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabe2de-f1ce-4738-ba12-5891e91a1044 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:38.032852 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabe2de-f1ce-4738-ba12-5891e91a1044 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:38.033134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabe2de-f1ce-4738-ba12-5891e91a1044 None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:38.033841 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabe2de-f1ce-4738-ba12-5891e91a1044 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:38.034152 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabe2de-f1ce-4738-ba12-5891e91a1044 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:38.035524 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabe2de-f1ce-4738-ba12-5891e91a1044 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:38.040106 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 379/758] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:48:37 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:39.599258 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5458b75-b2c6-4b0f-b260-757fbc339774 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:39.599839 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5458b75-b2c6-4b0f-b260-757fbc339774 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:39.599839 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5458b75-b2c6-4b0f-b260-757fbc339774 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:39.601136 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 380/759] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:39.606998 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f28e68-7e54-48cd-9461-7198a038a7a9 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:39.607423 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f28e68-7e54-48cd-9461-7198a038a7a9 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:39.607565 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f28e68-7e54-48cd-9461-7198a038a7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:39.625480 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-81f28e68-7e54-48cd-9461-7198a038a7a9 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:39.626723 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-81f28e68-7e54-48cd-9461-7198a038a7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:39.692830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 380/760] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:39 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:39.717473 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5458b75-b2c6-4b0f-b260-757fbc339774 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:39.765322 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:39.818638 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5458b75-b2c6-4b0f-b260-757fbc339774 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:39.853017 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e510426-e053-4130-b092-fc5a073ed403 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=beifPUfZQ7SpVpCu6Kbifg, audit_chain_id=['beifPUfZQ7SpVpCu6Kbifg']) at 0x7f8a140ba9a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:39.853656 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e510426-e053-4130-b092-fc5a073ed403 None admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:39.853942 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e510426-e053-4130-b092-fc5a073ed403 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:39.854217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e510426-e053-4130-b092-fc5a073ed403 None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:39.854907 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e510426-e053-4130-b092-fc5a073ed403 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:39.856274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e510426-e053-4130-b092-fc5a073ed403 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:39.870227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 381/761] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Jul 25 22:48:39 2022] POST /identity/v3/services => generated 269 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:48:40.298240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51820367-d1b8-40df-8144-6b2120f3c317 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:40.298529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51820367-d1b8-40df-8144-6b2120f3c317 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:40.298805 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51820367-d1b8-40df-8144-6b2120f3c317 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:40.300138 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 381/762] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:40.305286 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b17009-10f2-403e-bb72-f640eb28e64c None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:40.306221 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b17009-10f2-403e-bb72-f640eb28e64c None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:40.306645 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b17009-10f2-403e-bb72-f640eb28e64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:40.325134 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-56b17009-10f2-403e-bb72-f640eb28e64c None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:40.326407 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-56b17009-10f2-403e-bb72-f640eb28e64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:40.399101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 382/763] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:40 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:40.423094 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51820367-d1b8-40df-8144-6b2120f3c317 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:40.509636 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:40.533410 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51820367-d1b8-40df-8144-6b2120f3c317 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:40.567599 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c3178-698f-4966-a8f5-4e916180bc0d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=PmS-RjYVTW6s8l6obHQvcg, audit_chain_id=['PmS-RjYVTW6s8l6obHQvcg']) at 0x7f8a0fd29c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:40.568149 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c3178-698f-4966-a8f5-4e916180bc0d None admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:40.568431 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c3178-698f-4966-a8f5-4e916180bc0d None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:40.568706 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c3178-698f-4966-a8f5-4e916180bc0d None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:40.569393 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c3178-698f-4966-a8f5-4e916180bc0d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:40.570790 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c3178-698f-4966-a8f5-4e916180bc0d None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:40.584637 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 382/764] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Jul 25 22:48:40 2022] POST /identity/v3/services => generated 251 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:48:42.137904 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d475c-9d14-48d0-9f3e-d7a61a385c0e None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:42.138432 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d475c-9d14-48d0-9f3e-d7a61a385c0e None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:42.138432 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d475c-9d14-48d0-9f3e-d7a61a385c0e None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:42.140060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 383/765] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:42.145382 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e44d0-38f9-403d-b97c-119c336f3881 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:42.145819 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e44d0-38f9-403d-b97c-119c336f3881 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:42.146105 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e44d0-38f9-403d-b97c-119c336f3881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:42.164453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-e80e44d0-38f9-403d-b97c-119c336f3881 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:42.165724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-e80e44d0-38f9-403d-b97c-119c336f3881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:42.236532 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 383/766] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:42 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:42.261396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d475c-9d14-48d0-9f3e-d7a61a385c0e None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:42.293376 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:42.365393 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d475c-9d14-48d0-9f3e-d7a61a385c0e None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:42.400615 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad2a7c-04b3-4194-9d22-b199a7988bd0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=PNPYuqjGTJSUN6m9F4yK1Q, audit_chain_id=['PNPYuqjGTJSUN6m9F4yK1Q']) at 0x7f8a0fe18970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:42.401182 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad2a7c-04b3-4194-9d22-b199a7988bd0 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:42.401465 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad2a7c-04b3-4194-9d22-b199a7988bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:42.401765 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad2a7c-04b3-4194-9d22-b199a7988bd0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:42.402393 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad2a7c-04b3-4194-9d22-b199a7988bd0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:42.403762 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad2a7c-04b3-4194-9d22-b199a7988bd0 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:42.412597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-bfad2a7c-04b3-4194-9d22-b199a7988bd0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:48:42.412597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:42.412597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:42.412597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:42.412597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:42.412597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:42.412597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:42.412597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:42.412597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:48:42.412597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:42.412597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:42.412597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:42.412597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:42.412597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:42.412597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:42.412597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:42.413691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:42.413691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:42.413691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:42.413691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:42.413691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:42.413691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:42.413691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:42.413691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:42.413691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:42.413691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:42.413691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:42.413691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:42.413691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:42.413691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:42.413691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:42.413691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:42.414529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:42.414529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:42.414529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:42.414529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:42.414529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:42.414529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:42.414529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:42.414529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:42.414529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:42.414529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:42.414529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:42.414529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:42.414529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:42.414529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:48:42.414529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:42.414529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 384/767] 10.222.0.47 () {56 vars in 1132 bytes} [Mon Jul 25 22:48:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:42.419924 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e44d0-38f9-403d-b97c-119c336f3881 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:42.484081 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:42.523874 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e44d0-38f9-403d-b97c-119c336f3881 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:42.559521 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ba7d5-82b5-421d-9e23-220025fc9abe None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=PNPYuqjGTJSUN6m9F4yK1Q, audit_chain_id=['PNPYuqjGTJSUN6m9F4yK1Q']) at 0x7f8a0fdc0640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:42.560141 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ba7d5-82b5-421d-9e23-220025fc9abe None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:42.560427 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ba7d5-82b5-421d-9e23-220025fc9abe None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:42.560708 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ba7d5-82b5-421d-9e23-220025fc9abe None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:42.561388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ba7d5-82b5-421d-9e23-220025fc9abe None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:42.561732 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ba7d5-82b5-421d-9e23-220025fc9abe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:42.563101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ba7d5-82b5-421d-9e23-220025fc9abe None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:42.567784 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 384/768] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Jul 25 22:48:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:42.573627 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad2a7c-04b3-4194-9d22-b199a7988bd0 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:42.679414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:42.686025 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad2a7c-04b3-4194-9d22-b199a7988bd0 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:42.721600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6c441-19a8-4a18-8412-28fb662384a5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=PNPYuqjGTJSUN6m9F4yK1Q, audit_chain_id=['PNPYuqjGTJSUN6m9F4yK1Q']) at 0x7f8a150d8b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:42.722247 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6c441-19a8-4a18-8412-28fb662384a5 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:42.722534 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6c441-19a8-4a18-8412-28fb662384a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:42.722816 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6c441-19a8-4a18-8412-28fb662384a5 None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:42.723493 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6c441-19a8-4a18-8412-28fb662384a5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:42.723804 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6c441-19a8-4a18-8412-28fb662384a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:42.725189 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6c441-19a8-4a18-8412-28fb662384a5 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:42.730387 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 385/769] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Jul 25 22:48:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:42.736180 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ba7d5-82b5-421d-9e23-220025fc9abe None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:42.819475 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0d491-47c9-4fd1-a223-15fe23ca4b56 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:42.819766 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0d491-47c9-4fd1-a223-15fe23ca4b56 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:42.820046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0d491-47c9-4fd1-a223-15fe23ca4b56 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:42.822238 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 386/770] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:48:42.827062 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbc9f8-8a7a-4c76-b417-d68d4b2299dd None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:42.827329 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbc9f8-8a7a-4c76-b417-d68d4b2299dd None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:42.827614 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbc9f8-8a7a-4c76-b417-d68d4b2299dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:42.837570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ba7d5-82b5-421d-9e23-220025fc9abe None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:42.846516 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-02cbc9f8-8a7a-4c76-b417-d68d4b2299dd None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:42.847706 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-02cbc9f8-8a7a-4c76-b417-d68d4b2299dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:42.864513 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:42.873173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32632f7-fab2-4c6d-87cf-ff81cac318ba None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=PNPYuqjGTJSUN6m9F4yK1Q, audit_chain_id=['PNPYuqjGTJSUN6m9F4yK1Q']) at 0x7f8a0fcd8e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:42.873823 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32632f7-fab2-4c6d-87cf-ff81cac318ba None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:42.874108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32632f7-fab2-4c6d-87cf-ff81cac318ba None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:42.874387 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32632f7-fab2-4c6d-87cf-ff81cac318ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:42.875142 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32632f7-fab2-4c6d-87cf-ff81cac318ba None admin] RBAC: Adding query filter params (interface=public, service_id=20374b866cdf47af9071c974b1a37f25, region_id=RegionOne) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:42.875453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32632f7-fab2-4c6d-87cf-ff81cac318ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:42.876830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32632f7-fab2-4c6d-87cf-ff81cac318ba None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:42.881766 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 385/771] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Jul 25 22:48:42 2022] GET /identity/v3/endpoints?service_id=20374b866cdf47af9071c974b1a37f25&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:42.887861 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32632f7-fab2-4c6d-87cf-ff81cac318ba None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:42.915286 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 387/772] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:42 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:48:42.939181 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbc9f8-8a7a-4c76-b417-d68d4b2299dd None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:42.988252 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32632f7-fab2-4c6d-87cf-ff81cac318ba None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:43.025772 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c905cb9-d376-4846-86c4-afee4496cfe9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=PNPYuqjGTJSUN6m9F4yK1Q, audit_chain_id=['PNPYuqjGTJSUN6m9F4yK1Q']) at 0x7f8a0fe14160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:43.026443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c905cb9-d376-4846-86c4-afee4496cfe9 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:43.026730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c905cb9-d376-4846-86c4-afee4496cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:43.027061 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c905cb9-d376-4846-86c4-afee4496cfe9 None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:43.027714 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c905cb9-d376-4846-86c4-afee4496cfe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:43.029079 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c905cb9-d376-4846-86c4-afee4496cfe9 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:43.031007 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:43.035373 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 386/773] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Jul 25 22:48:42 2022] GET /identity/v3/services => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:48:43.048698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbc9f8-8a7a-4c76-b417-d68d4b2299dd None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:43.086178 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b990e1-2e9b-4078-b767-d68780139a33 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AgIVyhdyRfWnp-nHuBjd4A, audit_chain_id=['AgIVyhdyRfWnp-nHuBjd4A']) at 0x7f8a0fd267f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:43.087576 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b990e1-2e9b-4078-b767-d68780139a33 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:43.087861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b990e1-2e9b-4078-b767-d68780139a33 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:43.088140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b990e1-2e9b-4078-b767-d68780139a33 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:43.088793 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b990e1-2e9b-4078-b767-d68780139a33 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:43.090254 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b990e1-2e9b-4078-b767-d68780139a33 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:43.100092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-83b990e1-2e9b-4078-b767-d68780139a33 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:48:43.100092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:43.100092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:43.100092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:43.100092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:43.100092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:43.100092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:43.100092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:43.100092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:48:43.100092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:43.100092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:43.100092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:43.100092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:43.100092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:43.100092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:43.100092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:43.100092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:43.101327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:43.101327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:43.101327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:43.101327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:43.101327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:43.101327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:43.101327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:43.101327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:43.101327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:43.101327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:43.101327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:43.101327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:43.101327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:43.101327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:43.101327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:43.101327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:43.102303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:43.102303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:43.102303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:43.102303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:43.102303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:43.102303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:43.102303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:43.102303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:43.102303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:43.102303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:43.102303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:43.102303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:43.102303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:48:43.102303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:43.102303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 388/774] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:48:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:48:43.107672 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c905cb9-d376-4846-86c4-afee4496cfe9 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:43.176949 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:43.226354 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c905cb9-d376-4846-86c4-afee4496cfe9 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:43.261031 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bbd0c-dbeb-455f-b025-e1b2a0a7762f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AgIVyhdyRfWnp-nHuBjd4A, audit_chain_id=['AgIVyhdyRfWnp-nHuBjd4A']) at 0x7f8a0fdc3190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:43.261682 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bbd0c-dbeb-455f-b025-e1b2a0a7762f None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:43.261966 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bbd0c-dbeb-455f-b025-e1b2a0a7762f None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:43.262239 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bbd0c-dbeb-455f-b025-e1b2a0a7762f None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:43.262909 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bbd0c-dbeb-455f-b025-e1b2a0a7762f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:43.263210 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bbd0c-dbeb-455f-b025-e1b2a0a7762f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:43.264857 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bbd0c-dbeb-455f-b025-e1b2a0a7762f None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:43.269525 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 387/775] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:48:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:43.275576 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b990e1-2e9b-4078-b767-d68780139a33 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:43.376032 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b990e1-2e9b-4078-b767-d68780139a33 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:43.409912 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830becbf-95fd-4754-b12a-c89a1539839e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AgIVyhdyRfWnp-nHuBjd4A, audit_chain_id=['AgIVyhdyRfWnp-nHuBjd4A']) at 0x7f8a0fc613a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:43.410535 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830becbf-95fd-4754-b12a-c89a1539839e None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:43.410817 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830becbf-95fd-4754-b12a-c89a1539839e None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:43.411091 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830becbf-95fd-4754-b12a-c89a1539839e None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:43.411765 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830becbf-95fd-4754-b12a-c89a1539839e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:43.412069 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830becbf-95fd-4754-b12a-c89a1539839e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:43.413538 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830becbf-95fd-4754-b12a-c89a1539839e None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:43.418463 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 389/776] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:48:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:43.424299 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bbd0c-dbeb-455f-b025-e1b2a0a7762f None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:43.532125 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bbd0c-dbeb-455f-b025-e1b2a0a7762f None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:43.557043 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:43.572162 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af204ec-c077-4b9c-86db-6a623892c5ee None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AgIVyhdyRfWnp-nHuBjd4A, audit_chain_id=['AgIVyhdyRfWnp-nHuBjd4A']) at 0x7f8a0fde1a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:43.572785 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af204ec-c077-4b9c-86db-6a623892c5ee None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:43.573068 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af204ec-c077-4b9c-86db-6a623892c5ee None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:43.573339 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af204ec-c077-4b9c-86db-6a623892c5ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:43.574122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af204ec-c077-4b9c-86db-6a623892c5ee None admin] RBAC: Adding query filter params (interface=public, service_id=817b61cb623a443ba2b8b178337f046b, region_id=RegionOne) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:43.574427 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af204ec-c077-4b9c-86db-6a623892c5ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:43.575770 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af204ec-c077-4b9c-86db-6a623892c5ee None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:43.580768 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 388/777] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Jul 25 22:48:43 2022] GET /identity/v3/endpoints?service_id=817b61cb623a443ba2b8b178337f046b&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:43.586351 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830becbf-95fd-4754-b12a-c89a1539839e None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:43.607656 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:43.691346 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830becbf-95fd-4754-b12a-c89a1539839e None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:43.725249 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833a0ac-448e-4ac3-a187-a95839210830 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AgIVyhdyRfWnp-nHuBjd4A, audit_chain_id=['AgIVyhdyRfWnp-nHuBjd4A']) at 0x7f8a0fc9f100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:43.725911 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833a0ac-448e-4ac3-a187-a95839210830 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:43.726192 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833a0ac-448e-4ac3-a187-a95839210830 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:43.726469 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833a0ac-448e-4ac3-a187-a95839210830 None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:43.727641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833a0ac-448e-4ac3-a187-a95839210830 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:43.729640 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833a0ac-448e-4ac3-a187-a95839210830 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:43.735366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 390/778] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Jul 25 22:48:43 2022] GET /identity/v3/services => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:48:45.259575 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecfdd0-07f4-445f-8c3b-b562a39b6873 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:45.260135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecfdd0-07f4-445f-8c3b-b562a39b6873 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:45.260135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecfdd0-07f4-445f-8c3b-b562a39b6873 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:45.261439 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 389/779] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:45.266790 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84326892-9cc0-45c2-83f9-bec2822f8934 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:45.267178 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84326892-9cc0-45c2-83f9-bec2822f8934 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:45.267349 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84326892-9cc0-45c2-83f9-bec2822f8934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:45.285781 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-84326892-9cc0-45c2-83f9-bec2822f8934 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:45.286948 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-84326892-9cc0-45c2-83f9-bec2822f8934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:45.352470 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 391/780] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:45 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:45.376139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecfdd0-07f4-445f-8c3b-b562a39b6873 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:45.484885 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecfdd0-07f4-445f-8c3b-b562a39b6873 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:45.524686 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5e27a-838d-48ae-9e92-5139d4ed3352 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=GyhCM93YSFGKmP49ateWQA, audit_chain_id=['GyhCM93YSFGKmP49ateWQA']) at 0x7f8a0fd5c3a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:45.525237 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5e27a-838d-48ae-9e92-5139d4ed3352 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:45.525521 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5e27a-838d-48ae-9e92-5139d4ed3352 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:45.525825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5e27a-838d-48ae-9e92-5139d4ed3352 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:45.526449 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5e27a-838d-48ae-9e92-5139d4ed3352 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:45.527807 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5e27a-838d-48ae-9e92-5139d4ed3352 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:45.536734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-0fd5e27a-838d-48ae-9e92-5139d4ed3352 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:48:45.536734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:45.536734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:45.536734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:45.536734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:45.536734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:45.536734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:45.536734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:45.536734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:48:45.536734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:45.536734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:45.536734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:45.536734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:45.536734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:45.536734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:45.536734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:45.537978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:45.537978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:45.537978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:45.537978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:45.537978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:45.537978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:45.537978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:45.537978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:45.537978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:45.537978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:45.537978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:45.537978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:45.537978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:45.537978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:45.537978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:45.537978 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:45.539053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:45.539053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:45.539053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:45.539053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:45.539053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:45.539053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:45.539053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:45.539053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:45.539053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:45.539053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:45.539053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:45.539053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:45.539053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:45.539053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:48:45.539053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:45.539053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 390/781] 10.222.0.47 () {56 vars in 1132 bytes} [Mon Jul 25 22:48:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:45.543985 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84326892-9cc0-45c2-83f9-bec2822f8934 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:45.559298 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:45.648064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84326892-9cc0-45c2-83f9-bec2822f8934 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:45.681764 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d2d81-548b-4d11-89a3-3918a11199e3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=GyhCM93YSFGKmP49ateWQA, audit_chain_id=['GyhCM93YSFGKmP49ateWQA']) at 0x7f8a0fe138e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:45.682391 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d2d81-548b-4d11-89a3-3918a11199e3 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:45.682670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d2d81-548b-4d11-89a3-3918a11199e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:45.682944 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d2d81-548b-4d11-89a3-3918a11199e3 None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:45.683615 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d2d81-548b-4d11-89a3-3918a11199e3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:45.683918 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d2d81-548b-4d11-89a3-3918a11199e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:45.685287 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d2d81-548b-4d11-89a3-3918a11199e3 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:45.689859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 392/782] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Jul 25 22:48:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:45.695616 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5e27a-838d-48ae-9e92-5139d4ed3352 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:45.751467 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:45.803664 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5e27a-838d-48ae-9e92-5139d4ed3352 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:45.842345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa39704-c2f5-43c2-8e0b-0ca2fb00c4b4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=GyhCM93YSFGKmP49ateWQA, audit_chain_id=['GyhCM93YSFGKmP49ateWQA']) at 0x7f8a0fc9f580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:45.842966 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa39704-c2f5-43c2-8e0b-0ca2fb00c4b4 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:45.843247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa39704-c2f5-43c2-8e0b-0ca2fb00c4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:45.843522 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa39704-c2f5-43c2-8e0b-0ca2fb00c4b4 None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:45.844198 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa39704-c2f5-43c2-8e0b-0ca2fb00c4b4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:45.844502 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa39704-c2f5-43c2-8e0b-0ca2fb00c4b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:45.846159 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa39704-c2f5-43c2-8e0b-0ca2fb00c4b4 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:45.850982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 391/783] 10.222.0.47 () {56 vars in 1126 bytes} [Mon Jul 25 22:48:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:45.857160 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d2d81-548b-4d11-89a3-3918a11199e3 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:45.934086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:45.957226 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d2d81-548b-4d11-89a3-3918a11199e3 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:45.964990 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dc1b0-6afd-41f5-a563-dd4b5edd8ec8 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:45.965276 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dc1b0-6afd-41f5-a563-dd4b5edd8ec8 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:45.965558 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dc1b0-6afd-41f5-a563-dd4b5edd8ec8 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:45.967059 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 392/784] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:48:45.972009 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0b85a-3f61-4abb-98a3-bdb57352b227 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:45.972298 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0b85a-3f61-4abb-98a3-bdb57352b227 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:45.972581 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0b85a-3f61-4abb-98a3-bdb57352b227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:45.991448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-3ab0b85a-3f61-4abb-98a3-bdb57352b227 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:45.991637 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de542710-d990-48e3-a0ed-49318593a540 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=GyhCM93YSFGKmP49ateWQA, audit_chain_id=['GyhCM93YSFGKmP49ateWQA']) at 0x7f8a0fe3f790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:45.992110 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de542710-d990-48e3-a0ed-49318593a540 None admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:45.992395 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de542710-d990-48e3-a0ed-49318593a540 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:45.993343 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-3ab0b85a-3f61-4abb-98a3-bdb57352b227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:45.993490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de542710-d990-48e3-a0ed-49318593a540 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:45.994147 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de542710-d990-48e3-a0ed-49318593a540 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:45.995591 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de542710-d990-48e3-a0ed-49318593a540 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:46.017373 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 393/785] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 22:48:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:48:46.079121 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 393/786] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:45 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:48:46.104196 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de542710-d990-48e3-a0ed-49318593a540 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:46.208858 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de542710-d990-48e3-a0ed-49318593a540 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:46.240408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:46.247256 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0009366-ef06-473f-b9b9-a3e9b22a03cd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eVNLaxJSS6OA6xrhk7driw, audit_chain_id=['eVNLaxJSS6OA6xrhk7driw']) at 0x7f8a0fd0c6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:46.248163 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0009366-ef06-473f-b9b9-a3e9b22a03cd None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:46.248441 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0009366-ef06-473f-b9b9-a3e9b22a03cd None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:46.248717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0009366-ef06-473f-b9b9-a3e9b22a03cd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:46.249342 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0009366-ef06-473f-b9b9-a3e9b22a03cd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:46.251028 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0009366-ef06-473f-b9b9-a3e9b22a03cd None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:46.260478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-f0009366-ef06-473f-b9b9-a3e9b22a03cd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:48:46.260478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:46.260478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:46.260478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:46.260478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:46.260478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:46.260478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:46.260478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:46.260478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:48:46.260478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:46.260478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:46.260478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:46.260478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:46.260478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:46.260478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:46.260478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:46.260478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:46.261519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:46.261519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:46.261519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:46.261519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:46.261519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:46.261519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:46.261519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:46.261519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:46.261519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:46.261519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:46.261519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:46.261519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:46.261519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:46.261519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:46.261519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:46.261519 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:46.262524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:46.262524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:46.262524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:46.262524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:46.262524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:46.262524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:46.262524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:46.262524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:46.262524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:46.262524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:46.262524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:46.262524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:46.262524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:48:46.262524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:46.262524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 394/787] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:48:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:46.267824 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0b85a-3f61-4abb-98a3-bdb57352b227 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:46.307009 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:46.368898 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0b85a-3f61-4abb-98a3-bdb57352b227 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:46.403567 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93914df6-a8ce-4959-90f0-fd16c37b6781 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eVNLaxJSS6OA6xrhk7driw, audit_chain_id=['eVNLaxJSS6OA6xrhk7driw']) at 0x7f8a0fe9db80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:46.404188 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93914df6-a8ce-4959-90f0-fd16c37b6781 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:46.404468 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93914df6-a8ce-4959-90f0-fd16c37b6781 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:46.404742 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93914df6-a8ce-4959-90f0-fd16c37b6781 None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:46.405414 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93914df6-a8ce-4959-90f0-fd16c37b6781 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:46.405806 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93914df6-a8ce-4959-90f0-fd16c37b6781 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:46.407162 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93914df6-a8ce-4959-90f0-fd16c37b6781 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:46.412067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 394/788] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:48:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:46.418425 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0009366-ef06-473f-b9b9-a3e9b22a03cd None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:46.519007 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0009366-ef06-473f-b9b9-a3e9b22a03cd None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:46.553275 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb2c79-669e-402e-b20f-c2cbe772eec2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eVNLaxJSS6OA6xrhk7driw, audit_chain_id=['eVNLaxJSS6OA6xrhk7driw']) at 0x7f8a0fd42e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:46.553953 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb2c79-669e-402e-b20f-c2cbe772eec2 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:46.554235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb2c79-669e-402e-b20f-c2cbe772eec2 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:46.554503 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb2c79-669e-402e-b20f-c2cbe772eec2 None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:46.555461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb2c79-669e-402e-b20f-c2cbe772eec2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:46.555697 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb2c79-669e-402e-b20f-c2cbe772eec2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:46.561200 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb2c79-669e-402e-b20f-c2cbe772eec2 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:46.565426 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 395/789] 10.222.0.47 () {56 vars in 1114 bytes} [Mon Jul 25 22:48:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:46.571815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93914df6-a8ce-4959-90f0-fd16c37b6781 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:46.668955 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93914df6-a8ce-4959-90f0-fd16c37b6781 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:46.670422 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:46.703352 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfb950-5b36-4e9a-a758-037de1d7eef3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eVNLaxJSS6OA6xrhk7driw, audit_chain_id=['eVNLaxJSS6OA6xrhk7driw']) at 0x7f8a0fe14ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:46.703964 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfb950-5b36-4e9a-a758-037de1d7eef3 None admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:46.704244 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfb950-5b36-4e9a-a758-037de1d7eef3 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:46.704516 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfb950-5b36-4e9a-a758-037de1d7eef3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:46.705227 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfb950-5b36-4e9a-a758-037de1d7eef3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:46.706610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfb950-5b36-4e9a-a758-037de1d7eef3 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:46.726558 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 395/790] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 22:48:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:48:48.274586 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea99e42-0003-48e8-80d0-c831bd071f3e None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:48.275162 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea99e42-0003-48e8-80d0-c831bd071f3e None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:48.275162 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea99e42-0003-48e8-80d0-c831bd071f3e None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:48.276460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 396/791] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:48.281616 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecbe78-39ac-457b-895c-874863c540ec None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:48.282062 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecbe78-39ac-457b-895c-874863c540ec None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:48.282174 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecbe78-39ac-457b-895c-874863c540ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:48.299832 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-56ecbe78-39ac-457b-895c-874863c540ec None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:48.300997 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-56ecbe78-39ac-457b-895c-874863c540ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:48.374317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 396/792] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:48 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:48.398338 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea99e42-0003-48e8-80d0-c831bd071f3e None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:48.460542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:48.504130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea99e42-0003-48e8-80d0-c831bd071f3e None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:48.538509 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a4cf3-165f-41f5-9d6d-855caa654a08 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k3TcLlYTTdqhHQyNgjYWBA, audit_chain_id=['k3TcLlYTTdqhHQyNgjYWBA']) at 0x7f8a14110e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:48.539079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a4cf3-165f-41f5-9d6d-855caa654a08 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:48.540119 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a4cf3-165f-41f5-9d6d-855caa654a08 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:48.540407 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a4cf3-165f-41f5-9d6d-855caa654a08 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:48.541034 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a4cf3-165f-41f5-9d6d-855caa654a08 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:48.542431 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a4cf3-165f-41f5-9d6d-855caa654a08 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:48.551225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-9c0a4cf3-165f-41f5-9d6d-855caa654a08 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:48:48.551225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:48.551225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:48.551225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:48.551225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:48.551225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:48.551225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:48.551225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:48.551225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:48:48.551225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:48.551225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:48.551225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:48.551225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:48.551225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:48.551225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:48.551225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:48.551225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:48.552414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:48.552414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:48.552414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:48.552414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:48.552414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:48.552414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:48.552414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:48.552414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:48.552414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:48.552414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:48.552414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:48.552414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:48.552414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:48.552414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:48.552414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:48.552414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:48.553528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:48.553528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:48.553528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:48.553528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:48.553528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:48.553528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:48.553528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:48.553528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:48.553528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:48.553528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:48.553528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:48.553528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:48.553528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:48:48.553528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:48.553528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 397/793] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:48.558429 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecbe78-39ac-457b-895c-874863c540ec None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:48.641139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:48.657809 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecbe78-39ac-457b-895c-874863c540ec None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:48.691384 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013d6a2-d0ff-42ca-9ec3-60cb284a1b9c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k3TcLlYTTdqhHQyNgjYWBA, audit_chain_id=['k3TcLlYTTdqhHQyNgjYWBA']) at 0x7f8a0fdc38e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:48.692005 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013d6a2-d0ff-42ca-9ec3-60cb284a1b9c None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:48.692291 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013d6a2-d0ff-42ca-9ec3-60cb284a1b9c None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:48.692570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013d6a2-d0ff-42ca-9ec3-60cb284a1b9c None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:48.693242 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013d6a2-d0ff-42ca-9ec3-60cb284a1b9c None admin] RBAC: Adding query filter params (name=compute) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:48.693550 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013d6a2-d0ff-42ca-9ec3-60cb284a1b9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:48.694982 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013d6a2-d0ff-42ca-9ec3-60cb284a1b9c None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:48.700185 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 397/794] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 22:48:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:48.705861 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a4cf3-165f-41f5-9d6d-855caa654a08 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:48.804416 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a4cf3-165f-41f5-9d6d-855caa654a08 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:48.827870 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:48.840830 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7011f-c697-4e95-b9d2-b49efcad3725 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k3TcLlYTTdqhHQyNgjYWBA, audit_chain_id=['k3TcLlYTTdqhHQyNgjYWBA']) at 0x7f8a0fde2e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:48.841475 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7011f-c697-4e95-b9d2-b49efcad3725 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:48.841784 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7011f-c697-4e95-b9d2-b49efcad3725 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:48.842059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7011f-c697-4e95-b9d2-b49efcad3725 None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:48.842748 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7011f-c697-4e95-b9d2-b49efcad3725 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:48.843051 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7011f-c697-4e95-b9d2-b49efcad3725 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:48.844471 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7011f-c697-4e95-b9d2-b49efcad3725 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:48.849724 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 398/795] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 22:48:48 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:49.004374 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d944d1-2df1-47e9-9ee4-38f8fb861b2f None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:49.004823 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d944d1-2df1-47e9-9ee4-38f8fb861b2f None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:49.005216 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d944d1-2df1-47e9-9ee4-38f8fb861b2f None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:49.006603 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 398/796] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:49.013054 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1fde5-507d-4d09-8c92-a151de3cc787 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:49.013269 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1fde5-507d-4d09-8c92-a151de3cc787 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:49.013485 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1fde5-507d-4d09-8c92-a151de3cc787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:49.033228 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-30a1fde5-507d-4d09-8c92-a151de3cc787 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:49.034454 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-30a1fde5-507d-4d09-8c92-a151de3cc787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:49.102717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 399/797] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:49 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:49.126554 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d944d1-2df1-47e9-9ee4-38f8fb861b2f None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:49.227407 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d944d1-2df1-47e9-9ee4-38f8fb861b2f None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:49.262563 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b970d-6f66-41a4-bcec-6ccb4764c38f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ssHJ3rnFQIuG2QFdkDAw0A, audit_chain_id=['ssHJ3rnFQIuG2QFdkDAw0A']) at 0x7f8a0fccb670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:49.263188 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b970d-6f66-41a4-bcec-6ccb4764c38f None admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:49.263472 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b970d-6f66-41a4-bcec-6ccb4764c38f None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:49.263748 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b970d-6f66-41a4-bcec-6ccb4764c38f None admin] PATH_INFO: `/v3/projects` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:49.264753 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b970d-6f66-41a4-bcec-6ccb4764c38f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:49.267404 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b970d-6f66-41a4-bcec-6ccb4764c38f None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:49.272045 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: WARNING keystone.server.flask.common [None req-6f2b970d-6f66-41a4-bcec-6ccb4764c38f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 22:48:49.294677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.sql.core [None req-6f2b970d-6f66-41a4-bcec-6ccb4764c38f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 22:48:49.294677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 22:48:49.294677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [parameters: {'id': 'ac152b242de34bf7a73227abb4e34873', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 22:48:49.294677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93655) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 22:48:49.312511 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-6f2b970d-6f66-41a4-bcec-6ccb4764c38f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ac152b242de34bf7a73227abb4e34873.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ac152b242de34bf7a73227abb4e34873. Jul 25 22:48:49.312511 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:49.312511 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:48:49.312511 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:48:49.312511 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:48:49.312511 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:48:49.312511 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:48:49.312511 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:48:49.312511 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:48:49.312511 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:48:49.312511 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:48:49.312511 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:48:49.312511 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:48:49.313388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application result.read() Jul 25 22:48:49.313388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:48:49.313388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:48:49.313388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:48:49.313388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:48:49.313388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:48:49.313388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:48:49.313388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:48:49.313388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:48:49.313388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 22:48:49.313388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:49.313388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 22:48:49.313388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:49.313388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:49.313388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 22:48:49.313388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 22:48:49.313388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 22:48:49.313388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 22:48:49.314426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:48:49.314426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:48:49.314426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 22:48:49.314426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application yield resource Jul 25 22:48:49.314426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:48:49.314426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:48:49.314426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 22:48:49.314426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 22:48:49.314426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 22:48:49.314426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 22:48:49.314426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 22:48:49.314426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise self.value Jul 25 22:48:49.314426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 22:48:49.314426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 22:48:49.314426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 22:48:49.314426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application session.commit() Jul 25 22:48:49.314426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 22:48:49.315453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 22:48:49.315453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 22:48:49.315453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 22:48:49.315453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 22:48:49.315453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self.session.flush() Jul 25 22:48:49.315453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 22:48:49.315453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 22:48:49.315453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 22:48:49.315453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 22:48:49.315453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 22:48:49.315453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application compat.raise_( Jul 25 22:48:49.315453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:48:49.315453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception Jul 25 22:48:49.315453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 22:48:49.315453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 22:48:49.315453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 22:48:49.315453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 22:48:49.316391 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 22:48:49.316391 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 22:48:49.316391 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 22:48:49.316391 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 22:48:49.316391 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 22:48:49.316391 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 22:48:49.316391 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 22:48:49.316391 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 22:48:49.316391 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 22:48:49.316391 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 22:48:49.316391 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 22:48:49.316391 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 22:48:49.316391 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 22:48:49.316391 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 22:48:49.316391 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 22:48:49.317251 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 22:48:49.317251 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:48:49.317251 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception Jul 25 22:48:49.317251 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:48:49.317251 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:48:49.317251 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:48:49.317251 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:48:49.317251 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:48:49.317251 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:48:49.317251 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:48:49.317251 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:48:49.317251 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:48:49.317251 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:48:49.317251 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:48:49.317251 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application result.read() Jul 25 22:48:49.317251 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:48:49.317251 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:48:49.319625 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:48:49.319625 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:48:49.319625 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:48:49.319625 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:48:49.319625 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:48:49.319625 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:48:49.319625 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 22:48:49.319625 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 22:48:49.319625 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [parameters: {'id': 'ac152b242de34bf7a73227abb4e34873', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 22:48:49.319625 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 22:48:49.319625 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:49.319625 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:49.319625 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:49.319625 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:49.319625 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 22:48:49.321409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 22:48:49.321409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 22:48:49.321409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 22:48:49.321409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 22:48:49.321409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:49.321409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:49.321409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:49.321409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:49.321409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:49.321409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:49.321409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:49.321409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:49.321409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:49.321409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:49.321409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:49.321409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:49.321409 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:49.322830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:49.322830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 22:48:49.322830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 22:48:49.322830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:49.322830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:49.322830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 22:48:49.322830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 22:48:49.322830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ac152b242de34bf7a73227abb4e34873. Jul 25 22:48:49.322830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:49.322830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 399/798] 10.222.0.47 () {60 vars in 1140 bytes} [Mon Jul 25 22:48:49 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:49.324030 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1fde5-507d-4d09-8c92-a151de3cc787 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:49.419651 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1fde5-507d-4d09-8c92-a151de3cc787 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:49.437203 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:49.454548 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abe3c6-0089-4216-adfc-66a1748a4d06 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ssHJ3rnFQIuG2QFdkDAw0A, audit_chain_id=['ssHJ3rnFQIuG2QFdkDAw0A']) at 0x7f8a14128c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:49.455200 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abe3c6-0089-4216-adfc-66a1748a4d06 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:49.455483 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abe3c6-0089-4216-adfc-66a1748a4d06 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:49.455760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abe3c6-0089-4216-adfc-66a1748a4d06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:49.462739 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abe3c6-0089-4216-adfc-66a1748a4d06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:49.464187 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abe3c6-0089-4216-adfc-66a1748a4d06 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:49.475235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-d6abe3c6-0089-4216-adfc-66a1748a4d06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:49.475235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:49.475235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:49.475235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:49.475235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:49.475235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:49.475235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:49.475235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:49.475235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:49.475235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:49.475235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:49.475235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:49.475235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:48:49.475235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:48:49.475235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:48:49.476116 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:48:49.476116 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:49.476116 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:49.476116 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:49.476116 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:49.476116 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:49.476116 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:49.476116 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:49.476116 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:49.476116 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:49.476116 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:49.476116 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:49.476116 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:49.476116 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:49.476116 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:49.476116 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:49.476116 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:49.478150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:48:49.478150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:48:49.478150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:48:49.478150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:48:49.478150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:48:49.478150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:48:49.478150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:48:49.478150 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:49.482054 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 400/799] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:49.483226 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b970d-6f66-41a4-bcec-6ccb4764c38f None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:49.487400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:49.585941 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b970d-6f66-41a4-bcec-6ccb4764c38f None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:49.620881 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca27a18-4b60-45fc-a358-fa7c8944a4fe None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ssHJ3rnFQIuG2QFdkDAw0A, audit_chain_id=['ssHJ3rnFQIuG2QFdkDAw0A']) at 0x7f8a0fcd58b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:49.621671 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca27a18-4b60-45fc-a358-fa7c8944a4fe None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:49.622030 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca27a18-4b60-45fc-a358-fa7c8944a4fe None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:49.622381 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca27a18-4b60-45fc-a358-fa7c8944a4fe None admin] PATH_INFO: `/v3/projects` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:49.623175 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca27a18-4b60-45fc-a358-fa7c8944a4fe None admin] RBAC: Adding query filter params (name=service) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:49.623556 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca27a18-4b60-45fc-a358-fa7c8944a4fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:49.625250 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca27a18-4b60-45fc-a358-fa7c8944a4fe None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:49.645393 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 400/800] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 22:48:49 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:51.079191 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6752e-6520-478f-8ef9-60b83fb9f974 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:51.079746 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6752e-6520-478f-8ef9-60b83fb9f974 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:51.079746 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6752e-6520-478f-8ef9-60b83fb9f974 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:51.081046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 401/801] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:51.086274 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3f596-c65d-437c-bb91-9a6eaba7d804 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:51.086720 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3f596-c65d-437c-bb91-9a6eaba7d804 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:51.086849 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3f596-c65d-437c-bb91-9a6eaba7d804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:51.105815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-24b3f596-c65d-437c-bb91-9a6eaba7d804 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:51.107323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-24b3f596-c65d-437c-bb91-9a6eaba7d804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:51.165867 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:51.174743 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 401/802] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:51 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:51.198821 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6752e-6520-478f-8ef9-60b83fb9f974 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:51.304324 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6752e-6520-478f-8ef9-60b83fb9f974 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:51.338158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b310c58-13ff-4eaa-9190-0c0fd03cb424 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zrsXtF7jR6-zKp2NrPv_mQ, audit_chain_id=['zrsXtF7jR6-zKp2NrPv_mQ']) at 0x7f8a0fc0c9d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:51.338709 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b310c58-13ff-4eaa-9190-0c0fd03cb424 None admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:51.338992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b310c58-13ff-4eaa-9190-0c0fd03cb424 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:51.339271 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b310c58-13ff-4eaa-9190-0c0fd03cb424 None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:51.339969 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b310c58-13ff-4eaa-9190-0c0fd03cb424 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:51.341335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b310c58-13ff-4eaa-9190-0c0fd03cb424 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:51.356310 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 402/803] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Jul 25 22:48:51 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:48:51.920925 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bd926-8265-4c4f-9132-ca2888cf5c3f None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:51.921214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bd926-8265-4c4f-9132-ca2888cf5c3f None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:51.921485 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bd926-8265-4c4f-9132-ca2888cf5c3f None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:51.923001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 402/804] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:51.928559 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a077d-4cbb-4144-9de5-65e9ab1f7152 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:51.928853 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a077d-4cbb-4144-9de5-65e9ab1f7152 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:51.929130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a077d-4cbb-4144-9de5-65e9ab1f7152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:51.947662 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-678a077d-4cbb-4144-9de5-65e9ab1f7152 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:51.948829 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-678a077d-4cbb-4144-9de5-65e9ab1f7152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:51.978257 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:52.023252 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 403/805] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:51 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:48:52.049564 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bd926-8265-4c4f-9132-ca2888cf5c3f None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:52.150644 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bd926-8265-4c4f-9132-ca2888cf5c3f None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:52.184531 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd4a19-264b-4bf2-8202-ab2ad720b099 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XHyCq0blRLmmgr9pwUZmQA, audit_chain_id=['XHyCq0blRLmmgr9pwUZmQA']) at 0x7f8a0fd1ea00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:52.185083 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd4a19-264b-4bf2-8202-ab2ad720b099 None admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:52.185364 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd4a19-264b-4bf2-8202-ab2ad720b099 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:52.185672 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd4a19-264b-4bf2-8202-ab2ad720b099 None admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:52.186352 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd4a19-264b-4bf2-8202-ab2ad720b099 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:52.187774 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd4a19-264b-4bf2-8202-ab2ad720b099 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:52.202579 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.sql.core [None req-fecd4a19-264b-4bf2-8202-ab2ad720b099 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 22:48:52.202579 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 22:48:52.202579 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [parameters: {'user_id': 'ed1e32ed2bd6427097a39adb7f273f50', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 22:48:52.202579 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93655) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 22:48:52.209734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-fecd4a19-264b-4bf2-8202-ab2ad720b099 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 22:48:52.209734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:52.209734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:48:52.209734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:48:52.209734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:48:52.209734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:48:52.209734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:48:52.209734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:48:52.209734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:48:52.209734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:48:52.209734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:48:52.209734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:48:52.209734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:48:52.209734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application result.read() Jul 25 22:48:52.209734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:48:52.210594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:48:52.210594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:48:52.210594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:48:52.210594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:48:52.210594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:48:52.210594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:48:52.210594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:48:52.210594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 22:48:52.210594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:52.210594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 22:48:52.210594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:52.210594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:52.210594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 22:48:52.210594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 22:48:52.210594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 22:48:52.210594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 22:48:52.210594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:48:52.210594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:48:52.212221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 22:48:52.212221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application yield resource Jul 25 22:48:52.212221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:48:52.212221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:48:52.212221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 22:48:52.212221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 22:48:52.212221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 22:48:52.212221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 22:48:52.212221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 22:48:52.212221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise self.value Jul 25 22:48:52.212221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 22:48:52.212221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 22:48:52.212221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 22:48:52.212221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application session.commit() Jul 25 22:48:52.212221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 22:48:52.212221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 22:48:52.212221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 22:48:52.213084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 22:48:52.213084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 22:48:52.213084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self.session.flush() Jul 25 22:48:52.213084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 22:48:52.213084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 22:48:52.213084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 22:48:52.213084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 22:48:52.213084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 22:48:52.213084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application compat.raise_( Jul 25 22:48:52.213084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:48:52.213084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception Jul 25 22:48:52.213084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 22:48:52.213084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 22:48:52.213084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 22:48:52.213084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 22:48:52.213084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 22:48:52.213084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 22:48:52.213983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 22:48:52.213983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 22:48:52.213983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 22:48:52.213983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 22:48:52.213983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 22:48:52.213983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 22:48:52.213983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 22:48:52.213983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 22:48:52.213983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 22:48:52.213983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 22:48:52.213983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 22:48:52.213983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 22:48:52.213983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 22:48:52.213983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 22:48:52.213983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:48:52.213983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception Jul 25 22:48:52.214804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:48:52.214804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:48:52.214804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:48:52.214804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:48:52.214804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:48:52.214804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:48:52.214804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:48:52.214804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:48:52.214804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:48:52.214804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:48:52.214804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:48:52.214804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application result.read() Jul 25 22:48:52.214804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:48:52.214804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:48:52.214804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:48:52.214804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:48:52.215610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:48:52.215610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:48:52.215610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:48:52.215610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:48:52.215610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 22:48:52.215610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 22:48:52.215610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ed1e32ed2bd6427097a39adb7f273f50', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 22:48:52.215610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 22:48:52.215610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:52.215610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:52.215610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:52.215610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:52.215610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:52.215610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:52.215610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:52.217727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:52.217727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:52.217727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:52.217727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:52.217727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:52.217727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:52.217727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:52.217727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 22:48:52.217727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 22:48:52.217727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:52.217727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:52.217727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:52.217727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:52.217727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:52.217727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:52.217727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 22:48:52.217727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 22:48:52.219179 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 22:48:52.219179 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 22:48:52.219179 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 22:48:52.219179 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 22:48:52.219179 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 22:48:52.219179 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:52.219179 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 403/806] 10.222.0.47 () {60 vars in 1131 bytes} [Mon Jul 25 22:48:52 2022] POST /identity/v3/users => generated 160 bytes in 167 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:52.219892 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a077d-4cbb-4144-9de5-65e9ab1f7152 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:52.315560 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a077d-4cbb-4144-9de5-65e9ab1f7152 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:52.349293 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c50f4d-90df-4245-a693-48d96126e6b0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XHyCq0blRLmmgr9pwUZmQA, audit_chain_id=['XHyCq0blRLmmgr9pwUZmQA']) at 0x7f8a0fc836d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:52.349965 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c50f4d-90df-4245-a693-48d96126e6b0 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:52.350242 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c50f4d-90df-4245-a693-48d96126e6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:52.350517 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c50f4d-90df-4245-a693-48d96126e6b0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:52.357962 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c50f4d-90df-4245-a693-48d96126e6b0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:52.359437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c50f4d-90df-4245-a693-48d96126e6b0 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:52.371641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-01c50f4d-90df-4245-a693-48d96126e6b0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:48:52.371641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:52.371641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:52.371641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:52.371641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:52.371641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:52.371641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:52.371641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:52.371641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:52.371641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:52.371641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:52.371641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:52.371641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:48:52.371641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:48:52.371641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:48:52.371641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:48:52.372749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:52.372749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:52.372749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:48:52.372749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:52.372749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:48:52.372749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:48:52.372749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:52.372749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:52.372749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:52.372749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:52.372749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:52.372749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:52.372749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:52.372749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:52.372749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:52.372749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:52.372749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:52.372749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:52.373747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:52.373747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:52.373747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:48:52.373747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:48:52.373747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:48:52.373747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:48:52.373747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:48:52.373747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:48:52.373747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:48:52.373747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:52.373747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 404/807] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:48:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:52.379049 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd4a19-264b-4bf2-8202-ab2ad720b099 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:52.435271 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:52.482846 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd4a19-264b-4bf2-8202-ab2ad720b099 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:52.517959 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af58ca-d3da-402a-b37a-79587243190a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XHyCq0blRLmmgr9pwUZmQA, audit_chain_id=['XHyCq0blRLmmgr9pwUZmQA']) at 0x7f8a0fca9b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:52.518584 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af58ca-d3da-402a-b37a-79587243190a None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:52.518865 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af58ca-d3da-402a-b37a-79587243190a None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:52.519160 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af58ca-d3da-402a-b37a-79587243190a None admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:52.519917 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af58ca-d3da-402a-b37a-79587243190a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:52.520221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af58ca-d3da-402a-b37a-79587243190a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:52.521894 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af58ca-d3da-402a-b37a-79587243190a None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:52.563159 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 404/808] 10.222.0.47 () {56 vars in 1101 bytes} [Mon Jul 25 22:48:52 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:48:53.612221 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd36d4-0e3a-4a44-a11a-b45a8252e5a7 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:53.612761 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd36d4-0e3a-4a44-a11a-b45a8252e5a7 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:53.612761 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd36d4-0e3a-4a44-a11a-b45a8252e5a7 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:53.614126 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 405/809] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:53.619642 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7f777-3636-4f98-a4eb-e800cdbe8259 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:53.620054 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7f777-3636-4f98-a4eb-e800cdbe8259 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:53.620195 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7f777-3636-4f98-a4eb-e800cdbe8259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:53.638307 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-ece7f777-3636-4f98-a4eb-e800cdbe8259 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:53.641084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-ece7f777-3636-4f98-a4eb-e800cdbe8259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:53.705341 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 405/810] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:53 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:53.730016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd36d4-0e3a-4a44-a11a-b45a8252e5a7 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:53.755057 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:53.829883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd36d4-0e3a-4a44-a11a-b45a8252e5a7 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:53.862813 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719e63a-d15f-4b3a-912d-b19ab39c34b0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=GuZjxQdyS1yVJ6c0HFMmeA, audit_chain_id=['GuZjxQdyS1yVJ6c0HFMmeA']) at 0x7f8a0fc0e0a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:53.863433 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719e63a-d15f-4b3a-912d-b19ab39c34b0 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:53.863710 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719e63a-d15f-4b3a-912d-b19ab39c34b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:53.863986 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719e63a-d15f-4b3a-912d-b19ab39c34b0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:53.864595 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719e63a-d15f-4b3a-912d-b19ab39c34b0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:53.865981 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719e63a-d15f-4b3a-912d-b19ab39c34b0 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:53.875032 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-7719e63a-d15f-4b3a-912d-b19ab39c34b0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:48:53.875032 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:53.875032 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:53.875032 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:53.875032 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:53.875032 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:53.875032 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:53.875032 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:53.875032 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:48:53.875032 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:53.875032 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:53.875032 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:53.875032 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:53.875032 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:53.875032 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:53.875032 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:53.875032 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:53.876231 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:53.876231 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:53.876231 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:53.876231 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:53.876231 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:53.876231 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:53.876231 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:53.876231 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:53.876231 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:53.876231 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:53.876231 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:53.876231 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:53.876231 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:53.876231 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:53.876231 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:53.876231 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:53.877079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:53.877079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:53.877079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:53.877079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:53.877079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:53.877079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:53.877079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:53.877079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:53.877079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:53.877079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:53.877079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:53.877079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:53.877079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:48:53.877079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:48:53.877079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 406/811] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:53.882299 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7f777-3636-4f98-a4eb-e800cdbe8259 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:53.927575 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:53.980439 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7f777-3636-4f98-a4eb-e800cdbe8259 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:54.012935 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fec1ab-4f69-4da4-b18c-af28763e8189 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=GuZjxQdyS1yVJ6c0HFMmeA, audit_chain_id=['GuZjxQdyS1yVJ6c0HFMmeA']) at 0x7f8a0fdd9dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:54.013548 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fec1ab-4f69-4da4-b18c-af28763e8189 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:54.013862 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fec1ab-4f69-4da4-b18c-af28763e8189 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:54.014393 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fec1ab-4f69-4da4-b18c-af28763e8189 None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:54.015067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fec1ab-4f69-4da4-b18c-af28763e8189 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:54.015371 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fec1ab-4f69-4da4-b18c-af28763e8189 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:54.016723 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fec1ab-4f69-4da4-b18c-af28763e8189 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:54.021379 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 406/812] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 22:48:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:54.027878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719e63a-d15f-4b3a-912d-b19ab39c34b0 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:54.113639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:54.126233 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719e63a-d15f-4b3a-912d-b19ab39c34b0 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:54.160796 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b1f7a-2999-4adc-910b-6cc7123cef04 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=GuZjxQdyS1yVJ6c0HFMmeA, audit_chain_id=['GuZjxQdyS1yVJ6c0HFMmeA']) at 0x7f8a0fd26c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:54.161402 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b1f7a-2999-4adc-910b-6cc7123cef04 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:54.161714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b1f7a-2999-4adc-910b-6cc7123cef04 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:54.161993 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b1f7a-2999-4adc-910b-6cc7123cef04 None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:54.162650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b1f7a-2999-4adc-910b-6cc7123cef04 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:54.162947 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b1f7a-2999-4adc-910b-6cc7123cef04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:54.164880 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8b1f7a-2999-4adc-910b-6cc7123cef04 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:54.169485 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 407/813] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 22:48:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:54.175316 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fec1ab-4f69-4da4-b18c-af28763e8189 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:54.274164 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fec1ab-4f69-4da4-b18c-af28763e8189 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:54.283299 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:54.307606 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7592079-2892-4809-b521-da1a63cb16dd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=GuZjxQdyS1yVJ6c0HFMmeA, audit_chain_id=['GuZjxQdyS1yVJ6c0HFMmeA']) at 0x7f8a0fd29340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:54.308218 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7592079-2892-4809-b521-da1a63cb16dd None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:54.308500 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7592079-2892-4809-b521-da1a63cb16dd None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:54.308774 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7592079-2892-4809-b521-da1a63cb16dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:54.309515 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7592079-2892-4809-b521-da1a63cb16dd None admin] RBAC: Adding query filter params (interface=public, service_id=a3561f5d2c9a4757991e63f19b9c253e, region_id=RegionOne) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:54.309867 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7592079-2892-4809-b521-da1a63cb16dd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:54.311226 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7592079-2892-4809-b521-da1a63cb16dd None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:54.316061 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 407/814] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Jul 25 22:48:54 2022] GET /identity/v3/endpoints?service_id=a3561f5d2c9a4757991e63f19b9c253e&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:54.322561 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b1f7a-2999-4adc-910b-6cc7123cef04 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:54.420573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b1f7a-2999-4adc-910b-6cc7123cef04 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:54.454448 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f644807-7991-4b2f-8c82-c32d1252cd3f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=GuZjxQdyS1yVJ6c0HFMmeA, audit_chain_id=['GuZjxQdyS1yVJ6c0HFMmeA']) at 0x7f8a0fc753a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:54.455065 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f644807-7991-4b2f-8c82-c32d1252cd3f None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:54.455348 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f644807-7991-4b2f-8c82-c32d1252cd3f None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:54.455623 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f644807-7991-4b2f-8c82-c32d1252cd3f None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:54.456270 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f644807-7991-4b2f-8c82-c32d1252cd3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:54.457677 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f644807-7991-4b2f-8c82-c32d1252cd3f None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:54.464083 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 408/815] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Jul 25 22:48:54 2022] GET /identity/v3/services => generated 1728 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:48:56.720595 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ec9b6-5324-4ec2-a630-7f88447406f6 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:56.721136 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ec9b6-5324-4ec2-a630-7f88447406f6 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:56.721136 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ec9b6-5324-4ec2-a630-7f88447406f6 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:56.722567 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 408/816] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:56.727897 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e360e-b7c3-4fc4-b1fb-a8da3bfc9e68 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:56.728393 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e360e-b7c3-4fc4-b1fb-a8da3bfc9e68 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:56.728495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e360e-b7c3-4fc4-b1fb-a8da3bfc9e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:56.746702 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-c04e360e-b7c3-4fc4-b1fb-a8da3bfc9e68 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:56.747897 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-c04e360e-b7c3-4fc4-b1fb-a8da3bfc9e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:56.759296 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:56.813682 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 409/817] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:48:56 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:48:56.837666 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ec9b6-5324-4ec2-a630-7f88447406f6 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:56.938522 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ec9b6-5324-4ec2-a630-7f88447406f6 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:56.971003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bfd6c-a9c8-4042-9b9a-7e083ace1d99 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xXGeIgozSzaW_bG5RrEpMw, audit_chain_id=['xXGeIgozSzaW_bG5RrEpMw']) at 0x7f8a0fcb2df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:56.971628 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bfd6c-a9c8-4042-9b9a-7e083ace1d99 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:56.971912 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bfd6c-a9c8-4042-9b9a-7e083ace1d99 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:56.972185 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bfd6c-a9c8-4042-9b9a-7e083ace1d99 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:56.972801 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bfd6c-a9c8-4042-9b9a-7e083ace1d99 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:56.974179 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bfd6c-a9c8-4042-9b9a-7e083ace1d99 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:56.983538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-e61bfd6c-a9c8-4042-9b9a-7e083ace1d99 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:48:56.983538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:56.983538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:48:56.983538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:48:56.983538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:48:56.983538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:48:56.983538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:48:56.983538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:56.983538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:48:56.983538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:56.983538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:48:56.983538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:56.983538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:48:56.983538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:48:56.983538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:48:56.983538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:48:56.983538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:48:56.984698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:48:56.984698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:48:56.984698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:48:56.984698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:48:56.984698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:48:56.984698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:48:56.984698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:48:56.984698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:48:56.984698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:48:56.984698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:48:56.984698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:48:56.984698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:48:56.984698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:48:56.984698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:48:56.984698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:48:56.984698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:48:56.985751 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:48:56.985751 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:48:56.985751 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:48:56.985751 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:48:56.985751 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:48:56.985751 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:48:56.985751 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:48:56.985751 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:48:56.985751 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:48:56.985751 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:48:56.985751 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:48:56.985751 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:48:56.985751 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:48:56.985751 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:48:56.985751 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 409/818] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:48:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:48:56.990573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e360e-b7c3-4fc4-b1fb-a8da3bfc9e68 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:57.088287 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e360e-b7c3-4fc4-b1fb-a8da3bfc9e68 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:57.121314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4e1b8-19b4-4c42-ab36-a852289b494d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xXGeIgozSzaW_bG5RrEpMw, audit_chain_id=['xXGeIgozSzaW_bG5RrEpMw']) at 0x7f8a0fd83d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:57.121949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4e1b8-19b4-4c42-ab36-a852289b494d None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:57.122230 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4e1b8-19b4-4c42-ab36-a852289b494d None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:57.122506 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4e1b8-19b4-4c42-ab36-a852289b494d None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:57.123168 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4e1b8-19b4-4c42-ab36-a852289b494d None admin] RBAC: Adding query filter params (name=compute) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:57.123476 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4e1b8-19b4-4c42-ab36-a852289b494d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:57.124829 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4e1b8-19b4-4c42-ab36-a852289b494d None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:57.129370 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 410/819] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 22:48:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:57.135121 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bfd6c-a9c8-4042-9b9a-7e083ace1d99 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:57.170844 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:57.235136 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bfd6c-a9c8-4042-9b9a-7e083ace1d99 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:57.268196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b3d7d-0830-4a9c-a513-71ed16ec13de None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xXGeIgozSzaW_bG5RrEpMw, audit_chain_id=['xXGeIgozSzaW_bG5RrEpMw']) at 0x7f8a0fa25190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:57.268795 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b3d7d-0830-4a9c-a513-71ed16ec13de None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:57.269073 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b3d7d-0830-4a9c-a513-71ed16ec13de None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:57.269348 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b3d7d-0830-4a9c-a513-71ed16ec13de None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:57.270044 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b3d7d-0830-4a9c-a513-71ed16ec13de None admin] RBAC: Adding query filter params (type=compute) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:57.270348 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b3d7d-0830-4a9c-a513-71ed16ec13de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:57.271714 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b3d7d-0830-4a9c-a513-71ed16ec13de None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:57.276853 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 410/820] 10.222.0.47 () {56 vars in 1112 bytes} [Mon Jul 25 22:48:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:57.282575 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4e1b8-19b4-4c42-ab36-a852289b494d None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:57.295297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:57.391629 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4e1b8-19b4-4c42-ab36-a852289b494d None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:57.425366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d7975-8ecb-4cb0-8cd5-ae25faf8fc3c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xXGeIgozSzaW_bG5RrEpMw, audit_chain_id=['xXGeIgozSzaW_bG5RrEpMw']) at 0x7f8a0fd83a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:57.426019 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d7975-8ecb-4cb0-8cd5-ae25faf8fc3c None admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:57.426305 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d7975-8ecb-4cb0-8cd5-ae25faf8fc3c None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:57.426585 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d7975-8ecb-4cb0-8cd5-ae25faf8fc3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:57.427287 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d7975-8ecb-4cb0-8cd5-ae25faf8fc3c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:57.428663 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d7975-8ecb-4cb0-8cd5-ae25faf8fc3c None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:57.447796 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 411/821] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 22:48:57 2022] POST /identity/v3/endpoints => generated 334 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:49:07.274546 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=50 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:49:07.443566 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=66,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:49:58.617240 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d888ed0-1b81-4a40-9dff-d10a2e56c46a None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:58.617856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d888ed0-1b81-4a40-9dff-d10a2e56c46a None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:58.617856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d888ed0-1b81-4a40-9dff-d10a2e56c46a None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:58.619182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 411/822] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:49:58.625286 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc626789-383f-483d-b7cd-86237eb60699 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:58.625817 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc626789-383f-483d-b7cd-86237eb60699 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:58.625917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc626789-383f-483d-b7cd-86237eb60699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:58.647274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-bc626789-383f-483d-b7cd-86237eb60699 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:49:58.648657 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-bc626789-383f-483d-b7cd-86237eb60699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:49:58.746517 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 412/823] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:49:58 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:49:58.777139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d888ed0-1b81-4a40-9dff-d10a2e56c46a None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:49:58.907346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d888ed0-1b81-4a40-9dff-d10a2e56c46a None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:49:58.959351 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cf392-f815-476d-8635-537d7cb3f7f8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4_nyJG0UQUSNVDINsPq2Qg, audit_chain_id=['4_nyJG0UQUSNVDINsPq2Qg']) at 0x7f8a0fa1af40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:49:58.960196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cf392-f815-476d-8635-537d7cb3f7f8 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:58.960647 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cf392-f815-476d-8635-537d7cb3f7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:58.961030 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cf392-f815-476d-8635-537d7cb3f7f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:58.975068 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cf392-f815-476d-8635-537d7cb3f7f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:49:58.976626 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cf392-f815-476d-8635-537d7cb3f7f8 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:49:58.994555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-0a1cf392-f815-476d-8635-537d7cb3f7f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:49:58.994555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:49:58.994555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:49:58.994555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:49:58.994555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:49:58.994555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:49:58.994555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:49:58.994555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:49:58.994555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:49:58.994555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:49:58.994555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:49:58.994555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:49:58.994555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:49:58.994555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:49:58.994555 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:49:58.996367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:49:58.996367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:49:58.996367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:49:58.996367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:49:58.996367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:49:58.996367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:49:58.996367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:49:58.996367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:49:58.996367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:49:58.996367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:49:58.996367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:49:58.996367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:49:58.996367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:49:58.996367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:49:58.996367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:49:58.996367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:49:58.996367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:49:58.999278 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:49:58.999278 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:49:58.999278 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:49:58.999278 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:49:58.999278 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 412/824] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:49:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:49:59.005017 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc626789-383f-483d-b7cd-86237eb60699 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:49:59.126589 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc626789-383f-483d-b7cd-86237eb60699 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:49:59.161510 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:49:59.174521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc6336-8edd-4b4c-ac3b-26a94ba25e03 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4_nyJG0UQUSNVDINsPq2Qg, audit_chain_id=['4_nyJG0UQUSNVDINsPq2Qg']) at 0x7f8a0fe25b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:49:59.175552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc6336-8edd-4b4c-ac3b-26a94ba25e03 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:59.175845 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc6336-8edd-4b4c-ac3b-26a94ba25e03 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:59.176133 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc6336-8edd-4b4c-ac3b-26a94ba25e03 None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:59.177026 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc6336-8edd-4b4c-ac3b-26a94ba25e03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:49:59.177488 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc6336-8edd-4b4c-ac3b-26a94ba25e03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:49:59.179503 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc6336-8edd-4b4c-ac3b-26a94ba25e03 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:49:59.197666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 413/825] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:49:59.204495 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cf392-f815-476d-8635-537d7cb3f7f8 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:49:59.265702 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:49:59.332248 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cf392-f815-476d-8635-537d7cb3f7f8 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:49:59.372841 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cbdb5-e094-4ace-8153-5f67f9afa3bf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4_nyJG0UQUSNVDINsPq2Qg, audit_chain_id=['4_nyJG0UQUSNVDINsPq2Qg']) at 0x7f8a0fa1a9a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:49:59.373538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cbdb5-e094-4ace-8153-5f67f9afa3bf None admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:49:59.373871 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cbdb5-e094-4ace-8153-5f67f9afa3bf None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:49:59.374199 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cbdb5-e094-4ace-8153-5f67f9afa3bf None admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:49:59.374890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517cbdb5-e094-4ace-8153-5f67f9afa3bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:49:59.376348 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517cbdb5-e094-4ace-8153-5f67f9afa3bf None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:49:59.400693 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 413/826] 10.222.0.47 () {60 vars in 1132 bytes} [Mon Jul 25 22:49:59 2022] POST /identity/v3/users => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:50:01.821186 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d353ff-1dc4-424f-847e-d2a9b793ed64 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:01.821786 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d353ff-1dc4-424f-847e-d2a9b793ed64 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:01.821878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d353ff-1dc4-424f-847e-d2a9b793ed64 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:01.825621 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 414/827] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:50:01.829022 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de504c-8017-4275-bfff-b957c5d01f99 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:01.829501 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de504c-8017-4275-bfff-b957c5d01f99 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:01.829692 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de504c-8017-4275-bfff-b957c5d01f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:01.849961 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-09de504c-8017-4275-bfff-b957c5d01f99 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:50:01.851612 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-09de504c-8017-4275-bfff-b957c5d01f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:01.928489 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 414/828] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:50:01 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:50:01.957678 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d353ff-1dc4-424f-847e-d2a9b793ed64 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:02.082231 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d353ff-1dc4-424f-847e-d2a9b793ed64 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:02.121214 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec2966-c08d-44e9-8bf7-5dbbe1dfb115 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FeVbExJhThiNKQdQobXs4w, audit_chain_id=['FeVbExJhThiNKQdQobXs4w']) at 0x7f8a0fc9acd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:02.122244 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2966-c08d-44e9-8bf7-5dbbe1dfb115 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:02.122591 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2966-c08d-44e9-8bf7-5dbbe1dfb115 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:02.122844 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec2966-c08d-44e9-8bf7-5dbbe1dfb115 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:02.138009 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec2966-c08d-44e9-8bf7-5dbbe1dfb115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:50:02.142905 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-c4ec2966-c08d-44e9-8bf7-5dbbe1dfb115 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:50:02.142905 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:02.142905 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:02.142905 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:02.142905 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:02.142905 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:02.142905 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:02.142905 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:02.142905 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:02.142905 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:02.142905 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:02.142905 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:02.142905 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:50:02.142905 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:50:02.142905 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:50:02.142905 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:50:02.144405 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:50:02.144405 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:50:02.144405 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:50:02.144405 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:50:02.144405 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:02.144405 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:02.144405 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:02.144405 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:02.144405 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:02.144405 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:02.144405 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:02.144405 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:02.144405 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:02.144405 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:02.144405 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:02.144405 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:02.145821 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:02.145821 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:02.145821 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:02.145821 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:02.145821 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:50:02.145821 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:50:02.145821 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:50:02.145821 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:50:02.145821 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:50:02.145821 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:50:02.145821 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:50:02.145821 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:02.145821 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 415/829] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 22:50:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:02.150432 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de504c-8017-4275-bfff-b957c5d01f99 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:02.201210 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:02.271536 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de504c-8017-4275-bfff-b957c5d01f99 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:02.311993 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318247ed-4140-40e8-9045-cf91645dbe2d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FeVbExJhThiNKQdQobXs4w, audit_chain_id=['FeVbExJhThiNKQdQobXs4w']) at 0x7f8a0fd14e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:02.312756 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318247ed-4140-40e8-9045-cf91645dbe2d None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:02.313104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318247ed-4140-40e8-9045-cf91645dbe2d None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:02.313355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318247ed-4140-40e8-9045-cf91645dbe2d None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:02.314784 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318247ed-4140-40e8-9045-cf91645dbe2d None admin] RBAC: Adding query filter params (name=service) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:02.315095 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318247ed-4140-40e8-9045-cf91645dbe2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:02.317764 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318247ed-4140-40e8-9045-cf91645dbe2d None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:02.328235 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 415/830] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 22:50:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:50:02.334350 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec2966-c08d-44e9-8bf7-5dbbe1dfb115 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:02.389358 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:02.453853 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec2966-c08d-44e9-8bf7-5dbbe1dfb115 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:02.499799 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aaf36f-fd69-4774-b17d-7fd76fd0a404 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FeVbExJhThiNKQdQobXs4w, audit_chain_id=['FeVbExJhThiNKQdQobXs4w']) at 0x7f8a0fc18220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:02.500777 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaf36f-fd69-4774-b17d-7fd76fd0a404 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:02.501258 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaf36f-fd69-4774-b17d-7fd76fd0a404 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:02.501800 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaf36f-fd69-4774-b17d-7fd76fd0a404 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:02.519285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aaf36f-fd69-4774-b17d-7fd76fd0a404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:02.520988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aaf36f-fd69-4774-b17d-7fd76fd0a404 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:02.539130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-40aaf36f-fd69-4774-b17d-7fd76fd0a404 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:02.539130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:02.539130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:02.539130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:02.539130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:02.539130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:02.539130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:02.539130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:02.539130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:02.539130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:02.539130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:02.539130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:02.539130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:50:02.539130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:50:02.539130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:50:02.540366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:50:02.540366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:02.540366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:02.540366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:02.540366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:02.540366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:02.540366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:02.540366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:02.540366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:02.540366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:02.540366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:02.540366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:02.540366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:02.540366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:02.540366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:02.540366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:02.540366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:02.541628 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:50:02.541628 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:50:02.541628 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:02.541628 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:02.541628 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 416/831] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:02.546987 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318247ed-4140-40e8-9045-cf91645dbe2d None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:02.664006 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:02.666952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318247ed-4140-40e8-9045-cf91645dbe2d None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:02.705910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bdc93-795b-4508-8238-c1f783fabc52 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FeVbExJhThiNKQdQobXs4w, audit_chain_id=['FeVbExJhThiNKQdQobXs4w']) at 0x7f8a0fe87a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:02.706808 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bdc93-795b-4508-8238-c1f783fabc52 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:02.707165 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bdc93-795b-4508-8238-c1f783fabc52 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:02.707476 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bdc93-795b-4508-8238-c1f783fabc52 None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:02.708167 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bdc93-795b-4508-8238-c1f783fabc52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:02.708472 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bdc93-795b-4508-8238-c1f783fabc52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:02.709881 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bdc93-795b-4508-8238-c1f783fabc52 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:02.723521 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 416/832] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:02.729732 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aaf36f-fd69-4774-b17d-7fd76fd0a404 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:02.842829 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:02.847957 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aaf36f-fd69-4774-b17d-7fd76fd0a404 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:02.887852 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a0c08-3ba8-49b6-80a5-073a1fbbdde2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FeVbExJhThiNKQdQobXs4w, audit_chain_id=['FeVbExJhThiNKQdQobXs4w']) at 0x7f8a0fd1c820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:02.888541 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a0c08-3ba8-49b6-80a5-073a1fbbdde2 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:02.888852 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a0c08-3ba8-49b6-80a5-073a1fbbdde2 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:02.889151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a0c08-3ba8-49b6-80a5-073a1fbbdde2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:02.898252 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a0c08-3ba8-49b6-80a5-073a1fbbdde2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:02.899789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a0c08-3ba8-49b6-80a5-073a1fbbdde2 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:02.912204 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-903a0c08-3ba8-49b6-80a5-073a1fbbdde2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:50:02.912204 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:02.912204 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:02.912204 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:02.912204 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:02.912204 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:02.912204 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:02.912204 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:02.912204 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:02.912204 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:02.912204 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:02.912204 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:02.912204 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:50:02.912204 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:50:02.912204 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:50:02.912204 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:50:02.913436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:02.913436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:02.913436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:50:02.913436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:50:02.913436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:50:02.913436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:50:02.913436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:02.913436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:02.913436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:02.913436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:02.913436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:02.913436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:02.913436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:02.913436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:02.913436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:02.913436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:02.913436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:02.913436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:02.914706 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:02.914706 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:02.914706 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:50:02.914706 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:50:02.914706 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:50:02.914706 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:50:02.914706 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:50:02.914706 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:50:02.914706 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:50:02.914706 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:02.914706 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 417/833] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:50:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:02.919144 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bdc93-795b-4508-8238-c1f783fabc52 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:03.031632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bdc93-795b-4508-8238-c1f783fabc52 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:03.070657 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8056e-2f49-49e3-9086-51f52c37ac91 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FeVbExJhThiNKQdQobXs4w, audit_chain_id=['FeVbExJhThiNKQdQobXs4w']) at 0x7f8a0fa25af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:03.071254 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8056e-2f49-49e3-9086-51f52c37ac91 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:03.071539 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8056e-2f49-49e3-9086-51f52c37ac91 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:03.071817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8056e-2f49-49e3-9086-51f52c37ac91 None admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:03.072610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8056e-2f49-49e3-9086-51f52c37ac91 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:03.072921 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8056e-2f49-49e3-9086-51f52c37ac91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:03.074402 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8056e-2f49-49e3-9086-51f52c37ac91 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:03.092377 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 417/834] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Jul 25 22:50:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:03.099161 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a0c08-3ba8-49b6-80a5-073a1fbbdde2 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:03.220609 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a0c08-3ba8-49b6-80a5-073a1fbbdde2 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:03.256939 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6c380-46e9-42a8-9b61-73f6875b4c21 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FeVbExJhThiNKQdQobXs4w, audit_chain_id=['FeVbExJhThiNKQdQobXs4w']) at 0x7f8a0fc9fb50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:03.257569 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6c380-46e9-42a8-9b61-73f6875b4c21 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:03.257955 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6c380-46e9-42a8-9b61-73f6875b4c21 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:03.258217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6c380-46e9-42a8-9b61-73f6875b4c21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:03.288280 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:03.331973 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6c380-46e9-42a8-9b61-73f6875b4c21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:03.333696 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6c380-46e9-42a8-9b61-73f6875b4c21 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:03.439844 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 418/835] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:50:03 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:50:03.446371 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8056e-2f49-49e3-9086-51f52c37ac91 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:03.465841 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:03.557479 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8056e-2f49-49e3-9086-51f52c37ac91 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:03.602157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac502a3-b875-405c-b06e-b99ff0177f22 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FeVbExJhThiNKQdQobXs4w, audit_chain_id=['FeVbExJhThiNKQdQobXs4w']) at 0x7f8a0fcb92b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:03.603106 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac502a3-b875-405c-b06e-b99ff0177f22 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:03.603463 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac502a3-b875-405c-b06e-b99ff0177f22 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:03.603920 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac502a3-b875-405c-b06e-b99ff0177f22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:03.616039 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac502a3-b875-405c-b06e-b99ff0177f22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:03.617652 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac502a3-b875-405c-b06e-b99ff0177f22 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:03.635272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-3ac502a3-b875-405c-b06e-b99ff0177f22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:03.635272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:03.635272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:03.635272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:03.635272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:03.635272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:03.635272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:03.635272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:03.635272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:03.635272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:03.635272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:03.635272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:03.635272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:50:03.635272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:50:03.635272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:50:03.636265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:50:03.636265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:03.636265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:03.636265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:03.636265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:03.636265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:03.636265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:03.636265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:03.636265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:03.636265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:03.636265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:03.636265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:03.636265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:03.636265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:03.636265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:03.636265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:03.636265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:03.637429 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:50:03.637429 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:50:03.637429 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:03.637429 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:50:03.637429 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 418/836] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:50:03.643253 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6c380-46e9-42a8-9b61-73f6875b4c21 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:03.710895 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:03.756569 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6c380-46e9-42a8-9b61-73f6875b4c21 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:03.793227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458a833-1a51-49a0-a043-da13d9071e8e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FeVbExJhThiNKQdQobXs4w, audit_chain_id=['FeVbExJhThiNKQdQobXs4w']) at 0x7f8a0fd26340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:03.793928 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458a833-1a51-49a0-a043-da13d9071e8e None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:03.794284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458a833-1a51-49a0-a043-da13d9071e8e None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:03.794530 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458a833-1a51-49a0-a043-da13d9071e8e None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:03.795255 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458a833-1a51-49a0-a043-da13d9071e8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:03.795567 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458a833-1a51-49a0-a043-da13d9071e8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:03.797057 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458a833-1a51-49a0-a043-da13d9071e8e None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:03.809844 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 419/837] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:03.816668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac502a3-b875-405c-b06e-b99ff0177f22 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:03.895027 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:03.933703 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac502a3-b875-405c-b06e-b99ff0177f22 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:03.972272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89c1c7-a463-4c80-a96c-4310d5c94e98 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FeVbExJhThiNKQdQobXs4w, audit_chain_id=['FeVbExJhThiNKQdQobXs4w']) at 0x7f8a0fd5c610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:03.973196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89c1c7-a463-4c80-a96c-4310d5c94e98 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:03.973478 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89c1c7-a463-4c80-a96c-4310d5c94e98 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:03.973783 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89c1c7-a463-4c80-a96c-4310d5c94e98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:03.981193 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89c1c7-a463-4c80-a96c-4310d5c94e98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:03.982711 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89c1c7-a463-4c80-a96c-4310d5c94e98 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:03.996677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-3c89c1c7-a463-4c80-a96c-4310d5c94e98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:50:03.996677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:03.996677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:03.996677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:03.996677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:03.996677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:03.996677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:03.996677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:03.996677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:03.996677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:03.996677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:03.996677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:03.996677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:50:03.996677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:50:03.996677 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:50:03.997910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:50:03.997910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:03.997910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:03.997910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:03.997910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:03.997910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:03.997910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:03.997910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:03.997910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:03.997910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:03.997910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:03.997910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:03.997910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:03.997910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:03.997910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:03.997910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:03.997910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:03.999501 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:50:03.999501 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:50:03.999501 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:50:03.999501 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:50:03.999501 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:50:03.999501 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:50:03.999501 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:50:03.999501 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:50:03.999501 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 419/838] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:50:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:04.005336 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458a833-1a51-49a0-a043-da13d9071e8e None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:04.130394 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458a833-1a51-49a0-a043-da13d9071e8e None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:04.148265 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:04.167901 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60233ec5-7ced-4051-8a0c-89138441f585 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FeVbExJhThiNKQdQobXs4w, audit_chain_id=['FeVbExJhThiNKQdQobXs4w']) at 0x7f8a0fe257c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:04.168525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60233ec5-7ced-4051-8a0c-89138441f585 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:04.168802 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60233ec5-7ced-4051-8a0c-89138441f585 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:04.169072 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60233ec5-7ced-4051-8a0c-89138441f585 None admin] PATH_INFO: `/v3/projects` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:04.169847 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60233ec5-7ced-4051-8a0c-89138441f585 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:04.170159 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60233ec5-7ced-4051-8a0c-89138441f585 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:04.171608 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60233ec5-7ced-4051-8a0c-89138441f585 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:04.185222 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 420/839] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:50:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:04.193315 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89c1c7-a463-4c80-a96c-4310d5c94e98 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:04.311381 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89c1c7-a463-4c80-a96c-4310d5c94e98 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:04.344916 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:04.353081 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c3150-eba5-4599-a97f-107fa5617dfa None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FeVbExJhThiNKQdQobXs4w, audit_chain_id=['FeVbExJhThiNKQdQobXs4w']) at 0x7f8a0fa25b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:04.353744 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c3150-eba5-4599-a97f-107fa5617dfa None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:04.354032 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c3150-eba5-4599-a97f-107fa5617dfa None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:04.354310 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c3150-eba5-4599-a97f-107fa5617dfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:04.355090 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c3150-eba5-4599-a97f-107fa5617dfa None admin] RBAC: Adding query filter params (role.id=b50669f613ba46d78e9cb6c7e420b140, scope.project.id=2d1b44363d694c60867ec29af4f9d01e, user.id=530c96407340435c982fd99367689007) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:04.355399 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c3150-eba5-4599-a97f-107fa5617dfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:04.357252 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c3150-eba5-4599-a97f-107fa5617dfa None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:04.363931 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 420/840] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:50:04 2022] GET /identity/v3/role_assignments?user.id=530c96407340435c982fd99367689007&scope.project.id=2d1b44363d694c60867ec29af4f9d01e&role.id=b50669f613ba46d78e9cb6c7e420b140 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:06.732884 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52355517-460b-4b24-be23-8e45688f0d5c None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:06.733431 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52355517-460b-4b24-be23-8e45688f0d5c None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:06.733431 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52355517-460b-4b24-be23-8e45688f0d5c None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:06.734772 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 421/841] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:50:06.742267 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6c12e-44f9-4cba-b2aa-3ce27328af4b None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:06.742724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6c12e-44f9-4cba-b2aa-3ce27328af4b None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:06.743090 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6c12e-44f9-4cba-b2aa-3ce27328af4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:06.764478 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-d8a6c12e-44f9-4cba-b2aa-3ce27328af4b None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:50:06.765700 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-d8a6c12e-44f9-4cba-b2aa-3ce27328af4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:06.838489 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 421/842] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:50:06 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:50:06.867246 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52355517-460b-4b24-be23-8e45688f0d5c None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:06.981465 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52355517-460b-4b24-be23-8e45688f0d5c None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:07.025042 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fcc6e-d747-46ac-ba9d-f6b0156e9110 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=U80HzVe7Swau2Ygm9QlFPQ, audit_chain_id=['U80HzVe7Swau2Ygm9QlFPQ']) at 0x7f8a0fd62c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:07.026013 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fcc6e-d747-46ac-ba9d-f6b0156e9110 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:07.026305 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fcc6e-d747-46ac-ba9d-f6b0156e9110 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:07.026591 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fcc6e-d747-46ac-ba9d-f6b0156e9110 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:07.040102 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39fcc6e-d747-46ac-ba9d-f6b0156e9110 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:50:07.046429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-e39fcc6e-d747-46ac-ba9d-f6b0156e9110 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:50:07.046429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:07.046429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:07.046429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:07.046429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:07.046429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:07.046429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:07.046429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:07.046429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:07.046429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:07.046429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:07.046429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:07.046429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:50:07.046429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:50:07.046429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:50:07.046429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:50:07.047589 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:50:07.047589 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:50:07.047589 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:50:07.047589 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:50:07.047589 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:07.047589 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:07.047589 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:07.047589 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:07.047589 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:07.047589 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:07.047589 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:07.047589 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:07.047589 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:07.047589 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:07.047589 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:07.047589 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:07.048436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:07.048436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:07.048436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:07.048436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:07.048436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:50:07.048436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:50:07.048436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:50:07.048436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:50:07.048436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:50:07.048436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:50:07.048436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:50:07.048436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:07.048436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 422/843] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 22:50:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:07.054489 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6c12e-44f9-4cba-b2aa-3ce27328af4b None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:07.168506 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6c12e-44f9-4cba-b2aa-3ce27328af4b None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:07.200963 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:07.213228 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e41302-b6c9-4104-9349-57e8e5618a68 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=U80HzVe7Swau2Ygm9QlFPQ, audit_chain_id=['U80HzVe7Swau2Ygm9QlFPQ']) at 0x7f8a0fd29d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:07.213976 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e41302-b6c9-4104-9349-57e8e5618a68 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:07.214221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e41302-b6c9-4104-9349-57e8e5618a68 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:07.214591 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e41302-b6c9-4104-9349-57e8e5618a68 None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:07.215290 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e41302-b6c9-4104-9349-57e8e5618a68 None admin] RBAC: Adding query filter params (name=service) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:07.215595 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e41302-b6c9-4104-9349-57e8e5618a68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:07.216963 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e41302-b6c9-4104-9349-57e8e5618a68 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:07.226449 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 422/844] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 22:50:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:07.232338 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fcc6e-d747-46ac-ba9d-f6b0156e9110 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:07.275955 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:07.342525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fcc6e-d747-46ac-ba9d-f6b0156e9110 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:07.382949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7932200-17d0-46aa-92d3-907d048430a9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=U80HzVe7Swau2Ygm9QlFPQ, audit_chain_id=['U80HzVe7Swau2Ygm9QlFPQ']) at 0x7f8a0fd26e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:07.383599 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7932200-17d0-46aa-92d3-907d048430a9 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:07.383889 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7932200-17d0-46aa-92d3-907d048430a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:07.384170 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7932200-17d0-46aa-92d3-907d048430a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:07.395905 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7932200-17d0-46aa-92d3-907d048430a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:07.397503 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7932200-17d0-46aa-92d3-907d048430a9 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:07.414059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-b7932200-17d0-46aa-92d3-907d048430a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:07.414059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:07.414059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:07.414059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:07.414059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:07.414059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:07.414059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:07.414059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:07.414059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:07.414059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:07.414059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:07.414059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:07.414059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:50:07.414059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:50:07.414059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:50:07.415299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:50:07.415299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:07.415299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:07.415299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:07.415299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:07.415299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:07.415299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:07.415299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:07.415299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:07.415299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:07.415299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:07.415299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:07.415299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:07.415299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:07.415299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:07.415299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:07.415299 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:07.416429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:50:07.416429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:50:07.416429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:07.416429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:07.416429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 423/845] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:07.421444 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e41302-b6c9-4104-9349-57e8e5618a68 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:07.543016 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e41302-b6c9-4104-9349-57e8e5618a68 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:07.584271 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706d2a5-5dca-41e7-81f3-1c5d8aeba33c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=U80HzVe7Swau2Ygm9QlFPQ, audit_chain_id=['U80HzVe7Swau2Ygm9QlFPQ']) at 0x7f8a0fc49eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:07.584897 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706d2a5-5dca-41e7-81f3-1c5d8aeba33c None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:07.585183 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706d2a5-5dca-41e7-81f3-1c5d8aeba33c None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:07.585460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706d2a5-5dca-41e7-81f3-1c5d8aeba33c None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:07.586184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706d2a5-5dca-41e7-81f3-1c5d8aeba33c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:07.586490 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706d2a5-5dca-41e7-81f3-1c5d8aeba33c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:07.587855 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706d2a5-5dca-41e7-81f3-1c5d8aeba33c None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:07.600752 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 423/846] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:07.606918 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7932200-17d0-46aa-92d3-907d048430a9 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:07.701740 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:07.712662 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7932200-17d0-46aa-92d3-907d048430a9 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:07.749010 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171feca-062c-4cd7-9356-496331c2a686 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=U80HzVe7Swau2Ygm9QlFPQ, audit_chain_id=['U80HzVe7Swau2Ygm9QlFPQ']) at 0x7f8a0fc612b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:07.749849 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171feca-062c-4cd7-9356-496331c2a686 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:07.750230 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171feca-062c-4cd7-9356-496331c2a686 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:07.750548 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171feca-062c-4cd7-9356-496331c2a686 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:07.760595 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171feca-062c-4cd7-9356-496331c2a686 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:07.762628 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171feca-062c-4cd7-9356-496331c2a686 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:07.776079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-3171feca-062c-4cd7-9356-496331c2a686 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:50:07.776079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:07.776079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:07.776079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:07.776079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:07.776079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:07.776079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:07.776079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:07.776079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:07.776079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:07.776079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:07.776079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:07.776079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:50:07.776079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:50:07.776079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:50:07.776079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:50:07.777335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:07.777335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:07.777335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:50:07.777335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:50:07.777335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:50:07.777335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:50:07.777335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:07.777335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:07.777335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:07.777335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:07.777335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:07.777335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:07.777335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:07.777335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:07.777335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:07.777335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:07.777335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:07.777335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:07.778325 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:07.778325 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:07.778325 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:50:07.778325 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:50:07.778325 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:50:07.778325 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:50:07.778325 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:50:07.778325 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:50:07.778325 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:50:07.778325 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:07.778325 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 424/847] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:50:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:50:07.783326 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706d2a5-5dca-41e7-81f3-1c5d8aeba33c None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:07.837476 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:07.895974 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706d2a5-5dca-41e7-81f3-1c5d8aeba33c None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:07.939249 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19c98f-93d1-4e17-86b8-9adb86105088 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=U80HzVe7Swau2Ygm9QlFPQ, audit_chain_id=['U80HzVe7Swau2Ygm9QlFPQ']) at 0x7f8a0fd5ce20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:07.939945 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19c98f-93d1-4e17-86b8-9adb86105088 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:07.940328 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19c98f-93d1-4e17-86b8-9adb86105088 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:07.940822 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19c98f-93d1-4e17-86b8-9adb86105088 None admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:07.941796 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19c98f-93d1-4e17-86b8-9adb86105088 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:07.942116 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19c98f-93d1-4e17-86b8-9adb86105088 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:07.943688 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19c98f-93d1-4e17-86b8-9adb86105088 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:07.964128 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 424/848] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Jul 25 22:50:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:50:07.970209 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171feca-062c-4cd7-9356-496331c2a686 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:08.091382 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171feca-062c-4cd7-9356-496331c2a686 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:08.128524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21be76f-1617-4a17-bd09-34d45c2af852 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=U80HzVe7Swau2Ygm9QlFPQ, audit_chain_id=['U80HzVe7Swau2Ygm9QlFPQ']) at 0x7f8a0fc64dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:08.129164 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21be76f-1617-4a17-bd09-34d45c2af852 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:08.129441 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21be76f-1617-4a17-bd09-34d45c2af852 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:08.129750 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21be76f-1617-4a17-bd09-34d45c2af852 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:08.141592 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21be76f-1617-4a17-bd09-34d45c2af852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:08.143136 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21be76f-1617-4a17-bd09-34d45c2af852 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:08.158661 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-e21be76f-1617-4a17-bd09-34d45c2af852 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:08.158661 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:08.158661 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:08.158661 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:08.158661 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:08.158661 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:08.158661 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:08.158661 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:08.158661 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:08.158661 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:08.158661 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:08.158661 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:08.158661 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:50:08.158661 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:50:08.158661 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:50:08.160460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:50:08.160460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:08.160460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:08.160460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:08.160460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:08.160460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:08.160460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:08.160460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:08.160460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:08.160460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:08.160460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:08.160460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:08.160460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:08.160460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:08.160460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:08.160460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:08.160460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:08.161528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:50:08.161528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:50:08.161528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:08.161528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:08.161528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 425/849] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:08.166609 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19c98f-93d1-4e17-86b8-9adb86105088 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:08.279425 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19c98f-93d1-4e17-86b8-9adb86105088 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:08.282496 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:08.320970 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47173d33-dda9-4aa7-8cb3-9769e2b4409f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=U80HzVe7Swau2Ygm9QlFPQ, audit_chain_id=['U80HzVe7Swau2Ygm9QlFPQ']) at 0x7f8a0fc87220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:08.321637 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47173d33-dda9-4aa7-8cb3-9769e2b4409f None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:08.321949 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47173d33-dda9-4aa7-8cb3-9769e2b4409f None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:08.322218 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47173d33-dda9-4aa7-8cb3-9769e2b4409f None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:08.322903 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47173d33-dda9-4aa7-8cb3-9769e2b4409f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:08.323207 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47173d33-dda9-4aa7-8cb3-9769e2b4409f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:08.324727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47173d33-dda9-4aa7-8cb3-9769e2b4409f None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:08.337777 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 425/850] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:08.344305 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21be76f-1617-4a17-bd09-34d45c2af852 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:08.348482 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:08.462113 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21be76f-1617-4a17-bd09-34d45c2af852 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:08.502868 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc74855-9341-46e1-a716-b5f954e6dcd8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=U80HzVe7Swau2Ygm9QlFPQ, audit_chain_id=['U80HzVe7Swau2Ygm9QlFPQ']) at 0x7f8a0fc18fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:08.503640 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc74855-9341-46e1-a716-b5f954e6dcd8 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:08.503962 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc74855-9341-46e1-a716-b5f954e6dcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:08.504296 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc74855-9341-46e1-a716-b5f954e6dcd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:08.515138 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc74855-9341-46e1-a716-b5f954e6dcd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:08.517045 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc74855-9341-46e1-a716-b5f954e6dcd8 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:08.530883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-6cc74855-9341-46e1-a716-b5f954e6dcd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:50:08.530883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:08.530883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:08.530883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:08.530883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:08.530883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:08.530883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:08.530883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:08.530883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:08.530883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:08.530883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:08.530883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:08.530883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:50:08.530883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:50:08.530883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:50:08.531980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:50:08.531980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:08.531980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:08.531980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:08.531980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:08.531980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:08.531980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:08.531980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:08.531980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:08.531980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:08.531980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:08.531980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:08.531980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:08.531980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:08.531980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:08.531980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:08.531980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:08.532888 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:50:08.532888 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:50:08.532888 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:50:08.532888 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:50:08.532888 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:50:08.532888 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:50:08.532888 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:50:08.532888 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:08.532888 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 426/851] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:50:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:08.538678 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47173d33-dda9-4aa7-8cb3-9769e2b4409f None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:08.654725 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47173d33-dda9-4aa7-8cb3-9769e2b4409f None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:08.692197 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda58c50-4dbe-4c27-be28-480597309d5e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=U80HzVe7Swau2Ygm9QlFPQ, audit_chain_id=['U80HzVe7Swau2Ygm9QlFPQ']) at 0x7f8a0fc51700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:08.692847 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda58c50-4dbe-4c27-be28-480597309d5e None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:08.693130 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda58c50-4dbe-4c27-be28-480597309d5e None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:08.693393 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda58c50-4dbe-4c27-be28-480597309d5e None admin] PATH_INFO: `/v3/projects` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:08.694184 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda58c50-4dbe-4c27-be28-480597309d5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:08.694497 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda58c50-4dbe-4c27-be28-480597309d5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:08.695928 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda58c50-4dbe-4c27-be28-480597309d5e None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:08.709557 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 426/852] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:50:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:08.716052 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc74855-9341-46e1-a716-b5f954e6dcd8 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:08.786382 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:08.832000 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc74855-9341-46e1-a716-b5f954e6dcd8 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:08.869354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a6b25-6681-4fb0-8724-97257f407780 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=U80HzVe7Swau2Ygm9QlFPQ, audit_chain_id=['U80HzVe7Swau2Ygm9QlFPQ']) at 0x7f8a0fd2efa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:08.870074 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a6b25-6681-4fb0-8724-97257f407780 None admin] REQUEST_METHOD: `PUT` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:08.870366 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a6b25-6681-4fb0-8724-97257f407780 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:08.870643 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a6b25-6681-4fb0-8724-97257f407780 None admin] PATH_INFO: `/v3/projects/2d1b44363d694c60867ec29af4f9d01e/users/530c96407340435c982fd99367689007/roles/b50669f613ba46d78e9cb6c7e420b140` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:08.886039 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a6b25-6681-4fb0-8724-97257f407780 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d1b44363d694c60867ec29af4f9d01e, user_id=530c96407340435c982fd99367689007, role_id=b50669f613ba46d78e9cb6c7e420b140)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:08.887751 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a6b25-6681-4fb0-8724-97257f407780 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:08.901213 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 427/853] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 22:50:08 2022] PUT /identity/v3/projects/2d1b44363d694c60867ec29af4f9d01e/users/530c96407340435c982fd99367689007/roles/b50669f613ba46d78e9cb6c7e420b140 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:50:11.326220 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffa2be-38b0-4f2c-b01b-155424210d6d None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:11.326874 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffa2be-38b0-4f2c-b01b-155424210d6d None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:11.326874 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffa2be-38b0-4f2c-b01b-155424210d6d None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:11.328118 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 427/854] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:50:11.334417 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5ceff-8ceb-42d5-981b-a935e66ecf44 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:11.334977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5ceff-8ceb-42d5-981b-a935e66ecf44 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:11.334977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5ceff-8ceb-42d5-981b-a935e66ecf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:11.352976 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-97e5ceff-8ceb-42d5-981b-a935e66ecf44 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:50:11.354211 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-97e5ceff-8ceb-42d5-981b-a935e66ecf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:11.425121 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 428/855] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:50:11 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:50:11.452642 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffa2be-38b0-4f2c-b01b-155424210d6d None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:11.481021 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:11.567944 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffa2be-38b0-4f2c-b01b-155424210d6d None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:11.604142 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3843f3-31ca-4cee-93ec-26a571c11002 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=i5Uu2CRBQbe65XrdVOew2A, audit_chain_id=['i5Uu2CRBQbe65XrdVOew2A']) at 0x7f8a0fa2e580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:11.604572 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3843f3-31ca-4cee-93ec-26a571c11002 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:11.604854 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3843f3-31ca-4cee-93ec-26a571c11002 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:11.605127 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3843f3-31ca-4cee-93ec-26a571c11002 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:11.618107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3843f3-31ca-4cee-93ec-26a571c11002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:50:11.624305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-2d3843f3-31ca-4cee-93ec-26a571c11002 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:50:11.624305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:11.624305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:11.624305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:11.624305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:11.624305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:11.624305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:11.624305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:11.624305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:11.624305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:11.624305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:11.624305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:11.624305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:50:11.624305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:50:11.624305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:50:11.624305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:50:11.625417 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:50:11.625417 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:50:11.625417 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:50:11.625417 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:50:11.625417 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:11.625417 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:11.625417 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:11.625417 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:11.625417 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:11.625417 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:11.625417 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:11.625417 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:11.625417 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:11.625417 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:11.625417 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:11.625417 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:11.626744 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:11.626744 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:11.626744 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:11.626744 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:11.626744 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:50:11.626744 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:50:11.626744 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:50:11.626744 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:50:11.626744 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:50:11.626744 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:50:11.626744 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:50:11.626744 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:50:11.626744 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 428/856] 10.222.0.47 () {56 vars in 1102 bytes} [Mon Jul 25 22:50:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:11.633021 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5ceff-8ceb-42d5-981b-a935e66ecf44 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:11.680802 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:11.744320 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5ceff-8ceb-42d5-981b-a935e66ecf44 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:11.785800 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058c2c7-1360-4615-a82c-bf90ac38158d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=i5Uu2CRBQbe65XrdVOew2A, audit_chain_id=['i5Uu2CRBQbe65XrdVOew2A']) at 0x7f8a0fd88bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:11.786446 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058c2c7-1360-4615-a82c-bf90ac38158d None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:11.786729 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058c2c7-1360-4615-a82c-bf90ac38158d None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:11.787009 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058c2c7-1360-4615-a82c-bf90ac38158d None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:11.787775 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058c2c7-1360-4615-a82c-bf90ac38158d None admin] RBAC: Adding query filter params (name=service) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:11.788123 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058c2c7-1360-4615-a82c-bf90ac38158d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:11.789610 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058c2c7-1360-4615-a82c-bf90ac38158d None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:11.800768 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 429/857] 10.222.0.47 () {56 vars in 1103 bytes} [Mon Jul 25 22:50:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:11.805223 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3843f3-31ca-4cee-93ec-26a571c11002 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:11.903932 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:11.922242 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3843f3-31ca-4cee-93ec-26a571c11002 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:11.961254 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3a593-ef1d-40d1-b138-4e185bbf642d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=i5Uu2CRBQbe65XrdVOew2A, audit_chain_id=['i5Uu2CRBQbe65XrdVOew2A']) at 0x7f8a0fd5ce20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:11.961930 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3a593-ef1d-40d1-b138-4e185bbf642d None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:11.962363 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3a593-ef1d-40d1-b138-4e185bbf642d None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:11.962642 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3a593-ef1d-40d1-b138-4e185bbf642d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:11.973445 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3a593-ef1d-40d1-b138-4e185bbf642d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:11.975410 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3a593-ef1d-40d1-b138-4e185bbf642d None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:11.993572 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-7cd3a593-ef1d-40d1-b138-4e185bbf642d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:11.993572 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:11.993572 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:11.993572 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:11.993572 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:11.993572 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:11.993572 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:11.993572 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:11.993572 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:11.993572 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:11.993572 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:11.993572 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:11.993572 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:50:11.993572 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:50:11.993572 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:50:11.994667 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:50:11.994667 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:11.994667 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:11.994667 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:11.994667 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:11.994667 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:11.994667 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:11.994667 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:11.994667 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:11.994667 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:11.994667 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:11.994667 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:11.994667 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:11.994667 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:11.994667 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:11.994667 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:11.994667 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:11.995897 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:50:11.995897 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:50:11.995897 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:11.995897 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:50:11.995897 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 429/858] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:12.000648 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058c2c7-1360-4615-a82c-bf90ac38158d None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:12.135632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058c2c7-1360-4615-a82c-bf90ac38158d None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:12.138374 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:12.173192 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9ca3a-d457-4eaf-98f5-1149bc2b4303 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=i5Uu2CRBQbe65XrdVOew2A, audit_chain_id=['i5Uu2CRBQbe65XrdVOew2A']) at 0x7f8a0fd62d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:12.173774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9ca3a-d457-4eaf-98f5-1149bc2b4303 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:12.174058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9ca3a-d457-4eaf-98f5-1149bc2b4303 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:12.174361 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9ca3a-d457-4eaf-98f5-1149bc2b4303 None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:12.175397 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9ca3a-d457-4eaf-98f5-1149bc2b4303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:12.175702 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9ca3a-d457-4eaf-98f5-1149bc2b4303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:12.177071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9ca3a-d457-4eaf-98f5-1149bc2b4303 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:12.188834 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 430/859] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:12.197974 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3a593-ef1d-40d1-b138-4e185bbf642d None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:12.312546 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3a593-ef1d-40d1-b138-4e185bbf642d None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:12.351693 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e3487-1f40-4e40-86b1-bfc4a14e1615 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=i5Uu2CRBQbe65XrdVOew2A, audit_chain_id=['i5Uu2CRBQbe65XrdVOew2A']) at 0x7f8a0fa05100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:12.352348 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e3487-1f40-4e40-86b1-bfc4a14e1615 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:12.352606 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e3487-1f40-4e40-86b1-bfc4a14e1615 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:12.352883 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e3487-1f40-4e40-86b1-bfc4a14e1615 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:12.355764 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:12.361352 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e3487-1f40-4e40-86b1-bfc4a14e1615 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:12.363262 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e3487-1f40-4e40-86b1-bfc4a14e1615 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:12.376247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-414e3487-1f40-4e40-86b1-bfc4a14e1615 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:50:12.376247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:12.376247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:12.376247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:12.376247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:12.376247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:12.376247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:12.376247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:12.376247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:12.376247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:12.376247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:12.376247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:12.376247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:50:12.376247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:50:12.376247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:50:12.376247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:50:12.381360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:12.381360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:12.381360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:50:12.381360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:50:12.381360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:50:12.381360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:50:12.381360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:12.381360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:12.381360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:12.381360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:12.381360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:12.381360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:12.381360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:12.381360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:12.381360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:12.381360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:12.381360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:12.381360 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:12.382543 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:12.382543 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:12.382543 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:50:12.382543 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:50:12.382543 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:50:12.382543 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:50:12.382543 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:50:12.382543 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:50:12.382543 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:50:12.382543 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:50:12.382543 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 430/860] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:50:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:12.384458 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9ca3a-d457-4eaf-98f5-1149bc2b4303 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:12.500080 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9ca3a-d457-4eaf-98f5-1149bc2b4303 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:12.546836 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cab4b2-45eb-48ae-a50e-774a10cd2ab7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=i5Uu2CRBQbe65XrdVOew2A, audit_chain_id=['i5Uu2CRBQbe65XrdVOew2A']) at 0x7f8a0fc64040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:12.547622 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cab4b2-45eb-48ae-a50e-774a10cd2ab7 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:12.547997 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cab4b2-45eb-48ae-a50e-774a10cd2ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:12.548348 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cab4b2-45eb-48ae-a50e-774a10cd2ab7 None admin] PATH_INFO: `/v3/users` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:12.550123 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cab4b2-45eb-48ae-a50e-774a10cd2ab7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:12.550542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cab4b2-45eb-48ae-a50e-774a10cd2ab7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:12.552224 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cab4b2-45eb-48ae-a50e-774a10cd2ab7 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:12.571358 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 431/861] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Jul 25 22:50:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:12.577636 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e3487-1f40-4e40-86b1-bfc4a14e1615 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:12.696563 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e3487-1f40-4e40-86b1-bfc4a14e1615 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:12.736602 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad073d10-47e7-445f-871f-fe57c10a9aff None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=i5Uu2CRBQbe65XrdVOew2A, audit_chain_id=['i5Uu2CRBQbe65XrdVOew2A']) at 0x7f8a0fa1a400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:12.737879 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad073d10-47e7-445f-871f-fe57c10a9aff None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:12.738168 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad073d10-47e7-445f-871f-fe57c10a9aff None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:12.738437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad073d10-47e7-445f-871f-fe57c10a9aff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:12.807794 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:12.816332 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad073d10-47e7-445f-871f-fe57c10a9aff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:12.818302 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad073d10-47e7-445f-871f-fe57c10a9aff None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:12.930203 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 431/862] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:50:12 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:50:12.936431 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cab4b2-45eb-48ae-a50e-774a10cd2ab7 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:12.961878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:13.048216 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cab4b2-45eb-48ae-a50e-774a10cd2ab7 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:13.088347 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771aee9-9506-4f2c-9574-1b2feaba26c1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=i5Uu2CRBQbe65XrdVOew2A, audit_chain_id=['i5Uu2CRBQbe65XrdVOew2A']) at 0x7f8a0fd422b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:13.089002 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771aee9-9506-4f2c-9574-1b2feaba26c1 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:13.089293 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771aee9-9506-4f2c-9574-1b2feaba26c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:13.089593 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771aee9-9506-4f2c-9574-1b2feaba26c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:13.101491 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771aee9-9506-4f2c-9574-1b2feaba26c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:13.103132 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771aee9-9506-4f2c-9574-1b2feaba26c1 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:13.129217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-3771aee9-9506-4f2c-9574-1b2feaba26c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:13.129217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:13.129217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:13.129217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:13.129217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:13.129217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:13.129217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:13.129217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:13.129217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:13.129217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:13.129217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:13.129217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:13.129217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:50:13.129217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:50:13.129217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:50:13.130437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:50:13.130437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:13.130437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:13.130437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:13.130437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:13.130437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:13.130437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:13.130437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:13.130437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:13.130437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:13.130437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:13.130437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:13.130437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:13.130437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:13.130437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:13.130437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:13.130437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:13.137000 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:50:13.137000 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:50:13.137000 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:13.137000 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:13.137000 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 432/863] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:13.137365 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad073d10-47e7-445f-871f-fe57c10a9aff None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:13.248009 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:13.256838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad073d10-47e7-445f-871f-fe57c10a9aff None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:13.298781 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f9582-a42f-4bf1-98c6-a9bdacb8f306 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=i5Uu2CRBQbe65XrdVOew2A, audit_chain_id=['i5Uu2CRBQbe65XrdVOew2A']) at 0x7f8a0fa39fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:13.299564 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f9582-a42f-4bf1-98c6-a9bdacb8f306 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:13.299866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f9582-a42f-4bf1-98c6-a9bdacb8f306 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:13.300159 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f9582-a42f-4bf1-98c6-a9bdacb8f306 None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:13.300857 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f9582-a42f-4bf1-98c6-a9bdacb8f306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:13.301169 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f9582-a42f-4bf1-98c6-a9bdacb8f306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:13.302570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f9582-a42f-4bf1-98c6-a9bdacb8f306 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:13.314331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 432/864] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:13.321000 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771aee9-9506-4f2c-9574-1b2feaba26c1 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:13.416307 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:13.446919 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771aee9-9506-4f2c-9574-1b2feaba26c1 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:13.490529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108efc0-8291-4d90-b4d8-a646e7020813 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=i5Uu2CRBQbe65XrdVOew2A, audit_chain_id=['i5Uu2CRBQbe65XrdVOew2A']) at 0x7f8a0fc0cd30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:13.491132 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108efc0-8291-4d90-b4d8-a646e7020813 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:13.491478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108efc0-8291-4d90-b4d8-a646e7020813 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:13.491857 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108efc0-8291-4d90-b4d8-a646e7020813 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:13.500763 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108efc0-8291-4d90-b4d8-a646e7020813 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:13.502393 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108efc0-8291-4d90-b4d8-a646e7020813 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:13.516377 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-6108efc0-8291-4d90-b4d8-a646e7020813 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:50:13.516377 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:13.516377 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:13.516377 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:13.516377 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:13.516377 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:13.516377 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:13.516377 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:13.516377 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:13.516377 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:13.516377 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:13.516377 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:13.516377 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:50:13.516377 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:50:13.516377 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:50:13.517698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:50:13.517698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:13.517698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:13.517698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:13.517698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:13.517698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:13.517698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:13.517698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:13.517698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:13.517698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:13.517698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:13.517698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:13.517698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:13.517698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:13.517698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:13.517698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:13.517698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:13.522632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:50:13.522632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:50:13.522632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:50:13.522632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:50:13.522632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:50:13.522632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:50:13.522632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:50:13.522632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:13.522632 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 433/865] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:50:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:13.525209 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f9582-a42f-4bf1-98c6-a9bdacb8f306 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:13.646632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f9582-a42f-4bf1-98c6-a9bdacb8f306 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:13.685063 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca13e33-9fd1-4a70-882c-4d421b853831 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=i5Uu2CRBQbe65XrdVOew2A, audit_chain_id=['i5Uu2CRBQbe65XrdVOew2A']) at 0x7f8a0fd5cd90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:13.685778 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca13e33-9fd1-4a70-882c-4d421b853831 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:13.686076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca13e33-9fd1-4a70-882c-4d421b853831 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:13.686343 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca13e33-9fd1-4a70-882c-4d421b853831 None admin] PATH_INFO: `/v3/projects` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:13.687211 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca13e33-9fd1-4a70-882c-4d421b853831 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:13.687526 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca13e33-9fd1-4a70-882c-4d421b853831 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:13.689003 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca13e33-9fd1-4a70-882c-4d421b853831 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:13.704748 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 433/866] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:50:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:13.711735 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108efc0-8291-4d90-b4d8-a646e7020813 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:13.830090 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108efc0-8291-4d90-b4d8-a646e7020813 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:13.872540 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f28f5-b247-48ef-be8a-08d908936d71 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=i5Uu2CRBQbe65XrdVOew2A, audit_chain_id=['i5Uu2CRBQbe65XrdVOew2A']) at 0x7f8a0fc0efa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:13.873314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f28f5-b247-48ef-be8a-08d908936d71 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:13.873669 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f28f5-b247-48ef-be8a-08d908936d71 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:13.873980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f28f5-b247-48ef-be8a-08d908936d71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:13.874838 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f28f5-b247-48ef-be8a-08d908936d71 None admin] RBAC: Adding query filter params (role.id=b50669f613ba46d78e9cb6c7e420b140, scope.project.id=2d1b44363d694c60867ec29af4f9d01e, user.id=530c96407340435c982fd99367689007) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:13.875131 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f28f5-b247-48ef-be8a-08d908936d71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:13.876738 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f28f5-b247-48ef-be8a-08d908936d71 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:13.880098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:13.894627 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 434/867] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:50:13 2022] GET /identity/v3/role_assignments?user.id=530c96407340435c982fd99367689007&scope.project.id=2d1b44363d694c60867ec29af4f9d01e&role.id=b50669f613ba46d78e9cb6c7e420b140 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:16.519368 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee0e2d-a191-4a98-9ce2-a6f2c99fe1f2 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:16.520065 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee0e2d-a191-4a98-9ce2-a6f2c99fe1f2 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:16.520065 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee0e2d-a191-4a98-9ce2-a6f2c99fe1f2 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:16.521245 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 434/868] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:50:16.526515 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540dad5-5a76-49d7-b703-c2e7681ceee9 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:16.527227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540dad5-5a76-49d7-b703-c2e7681ceee9 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:16.527227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540dad5-5a76-49d7-b703-c2e7681ceee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:16.546685 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-6540dad5-5a76-49d7-b703-c2e7681ceee9 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:50:16.547918 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-6540dad5-5a76-49d7-b703-c2e7681ceee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:16.620265 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 435/869] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:50:16 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:50:16.649366 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee0e2d-a191-4a98-9ce2-a6f2c99fe1f2 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:16.669455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:16.762514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee0e2d-a191-4a98-9ce2-a6f2c99fe1f2 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:16.798734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbe74e-2597-4db9-b7d4-169e2b324d0a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xUmYbzKtRyi80YZ_3acXnw, audit_chain_id=['xUmYbzKtRyi80YZ_3acXnw']) at 0x7f8a0fa0e0d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:16.801087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbe74e-2597-4db9-b7d4-169e2b324d0a None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:16.801087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbe74e-2597-4db9-b7d4-169e2b324d0a None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:16.801087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbe74e-2597-4db9-b7d4-169e2b324d0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:16.810919 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddbe74e-2597-4db9-b7d4-169e2b324d0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:50:16.815810 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-fddbe74e-2597-4db9-b7d4-169e2b324d0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:50:16.815810 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:16.815810 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:16.815810 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:16.815810 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:16.815810 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:16.815810 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:16.815810 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:16.815810 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:16.815810 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:16.815810 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:16.815810 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:16.815810 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:50:16.815810 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:50:16.815810 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:50:16.815810 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:50:16.817076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:50:16.817076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:50:16.817076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:50:16.817076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:50:16.817076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:16.817076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:16.817076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:16.817076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:16.817076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:16.817076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:16.817076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:16.817076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:16.817076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:16.817076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:16.817076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:16.817076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:16.818076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:16.818076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:16.818076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:16.818076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:16.818076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:50:16.818076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:50:16.818076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:50:16.818076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:50:16.818076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:50:16.818076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:50:16.818076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:50:16.818076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:50:16.818076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 435/870] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 22:50:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:16.823448 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540dad5-5a76-49d7-b703-c2e7681ceee9 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:16.933889 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540dad5-5a76-49d7-b703-c2e7681ceee9 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:16.963467 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:16.975594 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b82fdf-89b8-49fd-958e-8fea366d2837 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xUmYbzKtRyi80YZ_3acXnw, audit_chain_id=['xUmYbzKtRyi80YZ_3acXnw']) at 0x7f8a0fd529d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:16.976394 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b82fdf-89b8-49fd-958e-8fea366d2837 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:16.976682 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b82fdf-89b8-49fd-958e-8fea366d2837 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:16.977010 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b82fdf-89b8-49fd-958e-8fea366d2837 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:16.978383 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b82fdf-89b8-49fd-958e-8fea366d2837 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:16.978881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b82fdf-89b8-49fd-958e-8fea366d2837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:16.980785 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b82fdf-89b8-49fd-958e-8fea366d2837 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:16.990618 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 436/871] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:50:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:16.996960 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbe74e-2597-4db9-b7d4-169e2b324d0a None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:17.088643 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:17.114305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbe74e-2597-4db9-b7d4-169e2b324d0a None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:17.154069 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff18dd2-2701-4b9e-a485-7b9654c07508 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xUmYbzKtRyi80YZ_3acXnw, audit_chain_id=['xUmYbzKtRyi80YZ_3acXnw']) at 0x7f8a0f9d01f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:17.154780 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff18dd2-2701-4b9e-a485-7b9654c07508 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:17.155106 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff18dd2-2701-4b9e-a485-7b9654c07508 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:17.155425 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff18dd2-2701-4b9e-a485-7b9654c07508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:17.168894 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff18dd2-2701-4b9e-a485-7b9654c07508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:17.170567 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff18dd2-2701-4b9e-a485-7b9654c07508 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:17.187161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-dff18dd2-2701-4b9e-a485-7b9654c07508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:17.187161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:17.187161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:17.187161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:17.187161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:17.187161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:17.187161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:17.187161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:17.187161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:17.187161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:17.187161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:17.187161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:17.187161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:50:17.187161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:50:17.187161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:50:17.188196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:50:17.188196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:17.188196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:17.188196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:17.188196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:17.188196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:17.188196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:17.188196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:17.188196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:17.188196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:17.188196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:17.188196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:17.188196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:17.188196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:17.188196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:17.188196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:17.188196 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:17.189136 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:50:17.189136 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:50:17.189136 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:17.189136 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:50:17.189136 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 436/872] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:17.194406 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b82fdf-89b8-49fd-958e-8fea366d2837 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:17.305291 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b82fdf-89b8-49fd-958e-8fea366d2837 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:17.340940 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee2130-7a4c-408e-abd4-67fc3ae64c45 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xUmYbzKtRyi80YZ_3acXnw, audit_chain_id=['xUmYbzKtRyi80YZ_3acXnw']) at 0x7f8a0fc61d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:17.341531 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee2130-7a4c-408e-abd4-67fc3ae64c45 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:17.341880 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee2130-7a4c-408e-abd4-67fc3ae64c45 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:17.342154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee2130-7a4c-408e-abd4-67fc3ae64c45 None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:17.342891 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee2130-7a4c-408e-abd4-67fc3ae64c45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:17.343221 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee2130-7a4c-408e-abd4-67fc3ae64c45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:17.344724 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee2130-7a4c-408e-abd4-67fc3ae64c45 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:17.357468 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 437/873] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:17.363209 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff18dd2-2701-4b9e-a485-7b9654c07508 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:17.480956 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff18dd2-2701-4b9e-a485-7b9654c07508 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:17.510476 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:17.520206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984e7e4-c4eb-4447-89b7-f4b93a8e01c9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xUmYbzKtRyi80YZ_3acXnw, audit_chain_id=['xUmYbzKtRyi80YZ_3acXnw']) at 0x7f8a0fc493a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:17.520928 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984e7e4-c4eb-4447-89b7-f4b93a8e01c9 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:17.521217 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984e7e4-c4eb-4447-89b7-f4b93a8e01c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:17.521494 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984e7e4-c4eb-4447-89b7-f4b93a8e01c9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:17.530453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984e7e4-c4eb-4447-89b7-f4b93a8e01c9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:17.531931 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984e7e4-c4eb-4447-89b7-f4b93a8e01c9 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:17.544864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-9984e7e4-c4eb-4447-89b7-f4b93a8e01c9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:50:17.544864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:17.544864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:17.544864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:17.544864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:17.544864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:17.544864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:17.544864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:17.544864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:17.544864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:17.544864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:17.544864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:17.544864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:50:17.544864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:50:17.544864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:50:17.544864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:50:17.546110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:17.546110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:17.546110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:50:17.546110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:50:17.546110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:50:17.546110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:50:17.546110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:17.546110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:17.546110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:17.546110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:17.546110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:17.546110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:17.546110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:17.546110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:17.546110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:17.546110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:17.546110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:17.546110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:17.547078 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:17.547078 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:17.547078 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:50:17.547078 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:50:17.547078 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:50:17.547078 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:50:17.547078 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:50:17.547078 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:50:17.547078 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:50:17.547078 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:50:17.547078 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 437/874] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:50:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:50:17.553391 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee2130-7a4c-408e-abd4-67fc3ae64c45 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:17.612433 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:17.666036 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee2130-7a4c-408e-abd4-67fc3ae64c45 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:17.701495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee31d6e-11f9-4589-bb49-ff2a67ca45b1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xUmYbzKtRyi80YZ_3acXnw, audit_chain_id=['xUmYbzKtRyi80YZ_3acXnw']) at 0x7f8a0fc619a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:17.702166 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee31d6e-11f9-4589-bb49-ff2a67ca45b1 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:17.702452 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee31d6e-11f9-4589-bb49-ff2a67ca45b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:17.702729 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee31d6e-11f9-4589-bb49-ff2a67ca45b1 None admin] PATH_INFO: `/v3/users` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:17.703534 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee31d6e-11f9-4589-bb49-ff2a67ca45b1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:17.703845 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee31d6e-11f9-4589-bb49-ff2a67ca45b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:17.705845 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee31d6e-11f9-4589-bb49-ff2a67ca45b1 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:17.726484 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 438/875] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Jul 25 22:50:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:17.732942 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984e7e4-c4eb-4447-89b7-f4b93a8e01c9 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:17.837608 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984e7e4-c4eb-4447-89b7-f4b93a8e01c9 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:17.872618 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1f125-deac-4c37-a1ac-ba1cb342d369 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xUmYbzKtRyi80YZ_3acXnw, audit_chain_id=['xUmYbzKtRyi80YZ_3acXnw']) at 0x7f8a0fa2e6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:17.873156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1f125-deac-4c37-a1ac-ba1cb342d369 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:17.873437 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1f125-deac-4c37-a1ac-ba1cb342d369 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:17.873744 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1f125-deac-4c37-a1ac-ba1cb342d369 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:17.932377 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:17.945684 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d1f125-deac-4c37-a1ac-ba1cb342d369 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:17.947242 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d1f125-deac-4c37-a1ac-ba1cb342d369 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:18.092402 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 438/876] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:50:17 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:50:18.097704 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee31d6e-11f9-4589-bb49-ff2a67ca45b1 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:18.214547 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee31d6e-11f9-4589-bb49-ff2a67ca45b1 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:18.224373 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:18.249327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414f775-613c-4b91-8955-3cd3b64e9f28 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xUmYbzKtRyi80YZ_3acXnw, audit_chain_id=['xUmYbzKtRyi80YZ_3acXnw']) at 0x7f8a0fc1ddc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:18.250001 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414f775-613c-4b91-8955-3cd3b64e9f28 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:18.250290 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414f775-613c-4b91-8955-3cd3b64e9f28 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:18.250571 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414f775-613c-4b91-8955-3cd3b64e9f28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:18.260584 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414f775-613c-4b91-8955-3cd3b64e9f28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:18.262345 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414f775-613c-4b91-8955-3cd3b64e9f28 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:18.276717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-c414f775-613c-4b91-8955-3cd3b64e9f28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:18.276717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:18.276717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:18.276717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:18.276717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:18.276717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:18.276717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:18.276717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:18.276717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:18.276717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:18.276717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:18.276717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:18.276717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:50:18.276717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:50:18.276717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:50:18.277774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:50:18.277774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:18.277774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:18.277774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:18.277774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:18.277774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:18.277774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:18.277774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:18.277774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:18.277774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:18.277774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:18.277774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:18.277774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:18.277774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:18.277774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:18.277774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:18.277774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:18.278866 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:50:18.278866 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:50:18.278866 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:18.278866 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:18.278866 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 439/877] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:18.284723 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1f125-deac-4c37-a1ac-ba1cb342d369 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:18.371131 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:18.383109 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d1f125-deac-4c37-a1ac-ba1cb342d369 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:18.415903 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b5d0a-38cd-496d-b23c-2dafeb62a4a7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xUmYbzKtRyi80YZ_3acXnw, audit_chain_id=['xUmYbzKtRyi80YZ_3acXnw']) at 0x7f8a0fa39910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:18.416509 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b5d0a-38cd-496d-b23c-2dafeb62a4a7 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:18.416788 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b5d0a-38cd-496d-b23c-2dafeb62a4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:18.417061 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b5d0a-38cd-496d-b23c-2dafeb62a4a7 None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:18.417763 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b5d0a-38cd-496d-b23c-2dafeb62a4a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:18.418066 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b5d0a-38cd-496d-b23c-2dafeb62a4a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:18.419424 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b5d0a-38cd-496d-b23c-2dafeb62a4a7 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:18.430826 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 439/878] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:18.436475 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414f775-613c-4b91-8955-3cd3b64e9f28 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:18.538550 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414f775-613c-4b91-8955-3cd3b64e9f28 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:18.571166 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce8297-90d1-4594-aba4-02dba4885c66 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xUmYbzKtRyi80YZ_3acXnw, audit_chain_id=['xUmYbzKtRyi80YZ_3acXnw']) at 0x7f8a0fc3e940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:18.571810 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce8297-90d1-4594-aba4-02dba4885c66 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:18.572096 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce8297-90d1-4594-aba4-02dba4885c66 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:18.572377 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce8297-90d1-4594-aba4-02dba4885c66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:18.578930 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce8297-90d1-4594-aba4-02dba4885c66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:18.580972 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce8297-90d1-4594-aba4-02dba4885c66 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:18.592130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-85ce8297-90d1-4594-aba4-02dba4885c66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:50:18.592130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:18.592130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:18.592130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:18.592130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:18.592130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:18.592130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:18.592130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:18.592130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:18.592130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:18.592130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:18.592130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:18.592130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:50:18.592130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:50:18.592130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:50:18.592992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:50:18.592992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:18.592992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:18.592992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:18.592992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:18.592992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:18.592992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:18.592992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:18.592992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:18.592992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:18.592992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:18.592992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:18.592992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:18.592992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:18.592992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:18.592992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:18.592992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:18.594064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:50:18.594064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:50:18.594064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:50:18.594064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:50:18.594064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:50:18.594064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:50:18.594064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:50:18.594064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:18.594064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 440/879] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:50:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:18.601140 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b5d0a-38cd-496d-b23c-2dafeb62a4a7 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:18.699727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b5d0a-38cd-496d-b23c-2dafeb62a4a7 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:18.733209 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b75cf-9cb5-469e-a2c9-4a7022bad2f1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xUmYbzKtRyi80YZ_3acXnw, audit_chain_id=['xUmYbzKtRyi80YZ_3acXnw']) at 0x7f8a0fa6f130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:18.733788 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b75cf-9cb5-469e-a2c9-4a7022bad2f1 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:18.734076 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b75cf-9cb5-469e-a2c9-4a7022bad2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:18.734357 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b75cf-9cb5-469e-a2c9-4a7022bad2f1 None admin] PATH_INFO: `/v3/projects` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:18.735096 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b75cf-9cb5-469e-a2c9-4a7022bad2f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:18.735408 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b75cf-9cb5-469e-a2c9-4a7022bad2f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:18.736912 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b75cf-9cb5-469e-a2c9-4a7022bad2f1 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:18.748686 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 440/880] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:50:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:18.754903 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce8297-90d1-4594-aba4-02dba4885c66 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:18.777896 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:18.855018 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce8297-90d1-4594-aba4-02dba4885c66 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:18.888284 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee752e9d-4760-46e1-9d1d-0810839ffd5e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xUmYbzKtRyi80YZ_3acXnw, audit_chain_id=['xUmYbzKtRyi80YZ_3acXnw']) at 0x7f8a0fd1c580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:18.888897 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee752e9d-4760-46e1-9d1d-0810839ffd5e None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:18.889183 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee752e9d-4760-46e1-9d1d-0810839ffd5e None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:18.889462 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee752e9d-4760-46e1-9d1d-0810839ffd5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:18.890274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee752e9d-4760-46e1-9d1d-0810839ffd5e None admin] RBAC: Adding query filter params (role.id=6ca03befbf3a456eae350bc7e583488f, scope.project.id=2d1b44363d694c60867ec29af4f9d01e, user.id=530c96407340435c982fd99367689007) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:18.890584 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee752e9d-4760-46e1-9d1d-0810839ffd5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:18.892015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee752e9d-4760-46e1-9d1d-0810839ffd5e None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:18.897936 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 441/881] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:50:18 2022] GET /identity/v3/role_assignments?user.id=530c96407340435c982fd99367689007&scope.project.id=2d1b44363d694c60867ec29af4f9d01e&role.id=6ca03befbf3a456eae350bc7e583488f => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:21.129403 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87c5b2-9bd0-40ee-bf00-144355e6b9a7 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:21.129975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87c5b2-9bd0-40ee-bf00-144355e6b9a7 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:21.129975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87c5b2-9bd0-40ee-bf00-144355e6b9a7 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:21.131306 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 441/882] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:50:21.136331 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2efbea-0429-4e54-9b02-90b4650cd38c None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:21.137006 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2efbea-0429-4e54-9b02-90b4650cd38c None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:21.137163 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2efbea-0429-4e54-9b02-90b4650cd38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:21.154905 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-7e2efbea-0429-4e54-9b02-90b4650cd38c None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:50:21.156095 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-7e2efbea-0429-4e54-9b02-90b4650cd38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:21.222562 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 442/883] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:50:21 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:50:21.246287 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87c5b2-9bd0-40ee-bf00-144355e6b9a7 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:21.257056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:21.346463 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87c5b2-9bd0-40ee-bf00-144355e6b9a7 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:21.379354 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc3563-bdad-4f56-a376-2d7a431cd812 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ssp8plhjRvyYGji-chD1vw, audit_chain_id=['ssp8plhjRvyYGji-chD1vw']) at 0x7f8a0fcd8b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:21.380033 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc3563-bdad-4f56-a376-2d7a431cd812 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:21.380258 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc3563-bdad-4f56-a376-2d7a431cd812 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:21.380532 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc3563-bdad-4f56-a376-2d7a431cd812 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:21.390483 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc3563-bdad-4f56-a376-2d7a431cd812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:50:21.396107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-09bc3563-bdad-4f56-a376-2d7a431cd812 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:50:21.396107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:21.396107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:21.396107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:21.396107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:21.396107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:21.396107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:21.396107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:21.396107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:21.396107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:21.396107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:21.396107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:21.396107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:50:21.396107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:50:21.396107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:50:21.396107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:50:21.397225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:50:21.397225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:50:21.397225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:50:21.397225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:50:21.397225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:21.397225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:21.397225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:21.397225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:21.397225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:21.397225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:21.397225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:21.397225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:21.397225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:21.397225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:21.397225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:21.397225 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:21.398108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:21.398108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:21.398108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:21.398108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:21.398108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:50:21.398108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:50:21.398108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:50:21.398108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:50:21.398108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:50:21.398108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:50:21.398108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:50:21.398108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:50:21.398108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 442/884] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 22:50:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:21.403357 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2efbea-0429-4e54-9b02-90b4650cd38c None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:21.418484 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:21.503186 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2efbea-0429-4e54-9b02-90b4650cd38c None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:21.536341 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d81c8-fccd-408a-8f4e-d1d196d75407 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ssp8plhjRvyYGji-chD1vw, audit_chain_id=['ssp8plhjRvyYGji-chD1vw']) at 0x7f8a0fd88460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:21.536961 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d81c8-fccd-408a-8f4e-d1d196d75407 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:21.537252 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d81c8-fccd-408a-8f4e-d1d196d75407 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:21.537531 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d81c8-fccd-408a-8f4e-d1d196d75407 None admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:21.538273 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d81c8-fccd-408a-8f4e-d1d196d75407 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:21.538579 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d81c8-fccd-408a-8f4e-d1d196d75407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:21.539944 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d81c8-fccd-408a-8f4e-d1d196d75407 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:21.548258 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 443/885] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:50:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:21.554949 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc3563-bdad-4f56-a376-2d7a431cd812 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:21.620470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:21.653879 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc3563-bdad-4f56-a376-2d7a431cd812 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:21.686754 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e823a-4dac-4e55-815b-c8f056e737d2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ssp8plhjRvyYGji-chD1vw, audit_chain_id=['ssp8plhjRvyYGji-chD1vw']) at 0x7f8a0fc87970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:21.687383 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e823a-4dac-4e55-815b-c8f056e737d2 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:21.687668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e823a-4dac-4e55-815b-c8f056e737d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:21.687944 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e823a-4dac-4e55-815b-c8f056e737d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:21.698511 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e823a-4dac-4e55-815b-c8f056e737d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:21.699944 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e823a-4dac-4e55-815b-c8f056e737d2 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:21.714334 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-7d3e823a-4dac-4e55-815b-c8f056e737d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:21.714334 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:21.714334 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:21.714334 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:21.714334 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:21.714334 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:21.714334 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:21.714334 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:21.714334 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:21.714334 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:21.714334 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:21.714334 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:21.714334 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:50:21.714334 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:50:21.714334 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:50:21.715346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:50:21.715346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:21.715346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:21.715346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:21.715346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:21.715346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:21.715346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:21.715346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:21.715346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:21.715346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:21.715346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:21.715346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:21.715346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:21.715346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:21.715346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:21.715346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:21.715346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:21.721676 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:50:21.721676 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:50:21.721676 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:21.721676 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:50:21.721676 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 443/886] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:21.722027 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d81c8-fccd-408a-8f4e-d1d196d75407 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:21.797597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:21.821304 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d81c8-fccd-408a-8f4e-d1d196d75407 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:21.853825 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53beaa-dd22-4b8e-8786-9d06aeaf4f09 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ssp8plhjRvyYGji-chD1vw, audit_chain_id=['ssp8plhjRvyYGji-chD1vw']) at 0x7f8a0fe46eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:21.854438 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53beaa-dd22-4b8e-8786-9d06aeaf4f09 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:21.854725 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53beaa-dd22-4b8e-8786-9d06aeaf4f09 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:21.855003 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f53beaa-dd22-4b8e-8786-9d06aeaf4f09 None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:21.855691 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53beaa-dd22-4b8e-8786-9d06aeaf4f09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:21.855999 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53beaa-dd22-4b8e-8786-9d06aeaf4f09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:21.857365 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f53beaa-dd22-4b8e-8786-9d06aeaf4f09 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:21.869371 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 444/887] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:21.874956 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e823a-4dac-4e55-815b-c8f056e737d2 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:21.972809 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e823a-4dac-4e55-815b-c8f056e737d2 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:21.992112 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:22.006459 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88c827-d602-4cf1-8817-e6a7e98d71f9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ssp8plhjRvyYGji-chD1vw, audit_chain_id=['ssp8plhjRvyYGji-chD1vw']) at 0x7f8a0fa397c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:22.007117 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88c827-d602-4cf1-8817-e6a7e98d71f9 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:22.007388 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88c827-d602-4cf1-8817-e6a7e98d71f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:22.007680 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88c827-d602-4cf1-8817-e6a7e98d71f9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:22.016846 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88c827-d602-4cf1-8817-e6a7e98d71f9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:22.018869 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88c827-d602-4cf1-8817-e6a7e98d71f9 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:22.031464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-db88c827-d602-4cf1-8817-e6a7e98d71f9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:50:22.031464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:22.031464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:22.031464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:22.031464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:22.031464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:22.031464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:22.031464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:22.031464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:22.031464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:22.031464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:22.031464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:22.031464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:50:22.031464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:50:22.031464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:50:22.031464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:50:22.032455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:22.032455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:22.032455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:50:22.032455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:50:22.032455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:50:22.032455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:50:22.032455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:22.032455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:22.032455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:22.032455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:22.032455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:22.032455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:22.032455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:22.032455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:22.032455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:22.032455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:22.032455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:22.032455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:22.034168 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:22.034168 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:22.034168 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:50:22.034168 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:50:22.034168 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:50:22.034168 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:50:22.034168 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:50:22.034168 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:50:22.034168 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:50:22.034168 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:50:22.034168 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 444/888] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:50:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:22.039633 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53beaa-dd22-4b8e-8786-9d06aeaf4f09 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:22.142781 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f53beaa-dd22-4b8e-8786-9d06aeaf4f09 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:22.176297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe568469-3cb2-4a18-a3d9-9a61ad7c2f6a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ssp8plhjRvyYGji-chD1vw, audit_chain_id=['ssp8plhjRvyYGji-chD1vw']) at 0x7f8a0fc9acd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:22.176910 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe568469-3cb2-4a18-a3d9-9a61ad7c2f6a None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:22.177198 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe568469-3cb2-4a18-a3d9-9a61ad7c2f6a None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:22.177474 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe568469-3cb2-4a18-a3d9-9a61ad7c2f6a None admin] PATH_INFO: `/v3/users` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:22.178285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe568469-3cb2-4a18-a3d9-9a61ad7c2f6a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:22.178594 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe568469-3cb2-4a18-a3d9-9a61ad7c2f6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:22.180031 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe568469-3cb2-4a18-a3d9-9a61ad7c2f6a None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:22.182551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:22.197092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 445/889] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Jul 25 22:50:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:22.202740 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88c827-d602-4cf1-8817-e6a7e98d71f9 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:22.305902 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88c827-d602-4cf1-8817-e6a7e98d71f9 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:22.338494 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad732f-c8fa-4d1f-8813-103a30915aa5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ssp8plhjRvyYGji-chD1vw, audit_chain_id=['ssp8plhjRvyYGji-chD1vw']) at 0x7f8a0f9c6970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:22.339128 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad732f-c8fa-4d1f-8813-103a30915aa5 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:22.339411 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad732f-c8fa-4d1f-8813-103a30915aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:22.339688 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad732f-c8fa-4d1f-8813-103a30915aa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:22.350674 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad732f-c8fa-4d1f-8813-103a30915aa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:22.352095 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad732f-c8fa-4d1f-8813-103a30915aa5 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:22.365941 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-6cad732f-c8fa-4d1f-8813-103a30915aa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:22.365941 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:22.365941 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:22.365941 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:22.365941 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:22.365941 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:22.365941 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:22.365941 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:22.365941 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:22.365941 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:22.365941 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:22.365941 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:22.365941 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:50:22.365941 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:50:22.365941 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:50:22.367001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:50:22.367001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:22.367001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:22.367001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:22.367001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:22.367001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:22.367001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:22.367001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:22.367001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:22.367001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:22.367001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:22.367001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:22.367001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:22.367001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:22.367001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:22.367001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:22.367001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:22.368281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:50:22.368281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:50:22.368281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:22.368281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:50:22.368281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 445/890] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:50:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:22.372789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe568469-3cb2-4a18-a3d9-9a61ad7c2f6a None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:22.472855 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe568469-3cb2-4a18-a3d9-9a61ad7c2f6a None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:22.506107 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57476ada-a52d-42c4-8984-bfb34bcb5f1b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ssp8plhjRvyYGji-chD1vw, audit_chain_id=['ssp8plhjRvyYGji-chD1vw']) at 0x7f8a0fd88850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:22.506728 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57476ada-a52d-42c4-8984-bfb34bcb5f1b None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:22.507016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57476ada-a52d-42c4-8984-bfb34bcb5f1b None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:22.507297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57476ada-a52d-42c4-8984-bfb34bcb5f1b None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:22.507984 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57476ada-a52d-42c4-8984-bfb34bcb5f1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:22.508292 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57476ada-a52d-42c4-8984-bfb34bcb5f1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:22.509718 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57476ada-a52d-42c4-8984-bfb34bcb5f1b None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:22.521555 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 446/891] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:22.527140 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad732f-c8fa-4d1f-8813-103a30915aa5 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:22.560736 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:22.633452 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad732f-c8fa-4d1f-8813-103a30915aa5 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:22.669596 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db795b21-1887-4ea8-a908-c2b18779618d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ssp8plhjRvyYGji-chD1vw, audit_chain_id=['ssp8plhjRvyYGji-chD1vw']) at 0x7f8a0fa01f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:22.670236 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db795b21-1887-4ea8-a908-c2b18779618d None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:22.670520 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db795b21-1887-4ea8-a908-c2b18779618d None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:22.670794 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db795b21-1887-4ea8-a908-c2b18779618d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:22.677476 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db795b21-1887-4ea8-a908-c2b18779618d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:22.678924 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db795b21-1887-4ea8-a908-c2b18779618d None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:22.690800 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-db795b21-1887-4ea8-a908-c2b18779618d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:50:22.690800 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:22.690800 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:22.690800 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:22.690800 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:22.690800 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:22.690800 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:22.690800 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:22.690800 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:22.690800 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:22.690800 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:22.690800 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:22.690800 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:50:22.690800 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:50:22.690800 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:50:22.691668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:50:22.691668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:22.691668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:22.691668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:22.691668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:22.691668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:22.691668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:22.691668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:22.691668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:22.691668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:22.691668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:22.691668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:22.691668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:22.691668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:22.691668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:22.691668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:22.691668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:22.692558 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:50:22.692558 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:50:22.692558 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:50:22.692558 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:50:22.692558 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:50:22.692558 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:50:22.692558 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:50:22.692558 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:50:22.692558 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 446/892] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:50:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:22.697755 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57476ada-a52d-42c4-8984-bfb34bcb5f1b None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:22.752659 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:22.796582 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57476ada-a52d-42c4-8984-bfb34bcb5f1b None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:22.829175 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20106497-0ca0-49f5-88cb-62e95f3a3ddf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ssp8plhjRvyYGji-chD1vw, audit_chain_id=['ssp8plhjRvyYGji-chD1vw']) at 0x7f8a0fd88bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:22.829803 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20106497-0ca0-49f5-88cb-62e95f3a3ddf None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:22.830625 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20106497-0ca0-49f5-88cb-62e95f3a3ddf None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:22.830853 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20106497-0ca0-49f5-88cb-62e95f3a3ddf None admin] PATH_INFO: `/v3/projects` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:22.831588 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20106497-0ca0-49f5-88cb-62e95f3a3ddf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:22.831896 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20106497-0ca0-49f5-88cb-62e95f3a3ddf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:22.833314 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20106497-0ca0-49f5-88cb-62e95f3a3ddf None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:22.844952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 447/893] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:50:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:22.851110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db795b21-1887-4ea8-a908-c2b18779618d None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:22.941125 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:22.950174 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db795b21-1887-4ea8-a908-c2b18779618d None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:22.982637 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c66757-9ab3-4f42-9d7c-97b82fb4c623 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ssp8plhjRvyYGji-chD1vw, audit_chain_id=['ssp8plhjRvyYGji-chD1vw']) at 0x7f8a0fd5cd90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:22.983297 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c66757-9ab3-4f42-9d7c-97b82fb4c623 None admin] REQUEST_METHOD: `PUT` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:22.983585 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c66757-9ab3-4f42-9d7c-97b82fb4c623 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:22.983867 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c66757-9ab3-4f42-9d7c-97b82fb4c623 None admin] PATH_INFO: `/v3/projects/2d1b44363d694c60867ec29af4f9d01e/users/530c96407340435c982fd99367689007/roles/6ca03befbf3a456eae350bc7e583488f` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:22.986461 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c66757-9ab3-4f42-9d7c-97b82fb4c623 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d1b44363d694c60867ec29af4f9d01e, user_id=530c96407340435c982fd99367689007, role_id=6ca03befbf3a456eae350bc7e583488f)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:22.987980 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c66757-9ab3-4f42-9d7c-97b82fb4c623 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:23.000094 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 447/894] 10.222.0.47 () {58 vars in 1439 bytes} [Mon Jul 25 22:50:22 2022] PUT /identity/v3/projects/2d1b44363d694c60867ec29af4f9d01e/users/530c96407340435c982fd99367689007/roles/6ca03befbf3a456eae350bc7e583488f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:50:25.232418 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaea0c-3c4f-41c2-b76f-b9d95e482836 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:25.232975 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaea0c-3c4f-41c2-b76f-b9d95e482836 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:25.232975 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aaea0c-3c4f-41c2-b76f-b9d95e482836 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:25.234336 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 448/895] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:50:25.239523 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3e1a-3582-4028-a3da-30b660958fc4 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:25.239960 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3e1a-3582-4028-a3da-30b660958fc4 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:25.240066 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3e1a-3582-4028-a3da-30b660958fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:25.257785 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-c8fd3e1a-3582-4028-a3da-30b660958fc4 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:50:25.258959 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-c8fd3e1a-3582-4028-a3da-30b660958fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:25.323211 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 448/896] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:50:25 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:50:25.348232 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaea0c-3c4f-41c2-b76f-b9d95e482836 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:25.448885 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aaea0c-3c4f-41c2-b76f-b9d95e482836 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:25.463298 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:25.484288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72728f-795d-49d3-b096-60ecabe73b95 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=njrbViEnS82nKWZjIBArXQ, audit_chain_id=['njrbViEnS82nKWZjIBArXQ']) at 0x7f8a0fd2ea00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:25.484883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72728f-795d-49d3-b096-60ecabe73b95 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:25.485172 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72728f-795d-49d3-b096-60ecabe73b95 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:25.485452 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72728f-795d-49d3-b096-60ecabe73b95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:25.496086 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72728f-795d-49d3-b096-60ecabe73b95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:50:25.501026 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-cb72728f-795d-49d3-b096-60ecabe73b95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:50:25.501026 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:25.501026 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:25.501026 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:25.501026 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:25.501026 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:25.501026 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:25.501026 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:25.501026 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:25.501026 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:25.501026 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:25.501026 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:25.501026 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:50:25.501026 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:50:25.501026 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:50:25.501026 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:50:25.502881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:50:25.502881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:50:25.502881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:50:25.502881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:50:25.502881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:25.502881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:25.502881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:25.502881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:25.502881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:25.502881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:25.502881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:25.502881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:25.502881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:25.502881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:25.502881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:25.502881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:25.503749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:25.503749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:25.503749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:25.503749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:25.503749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:50:25.503749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:50:25.503749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:50:25.503749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:50:25.503749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:50:25.503749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:50:25.503749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:50:25.503749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:25.503749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 449/897] 10.222.0.47 () {56 vars in 1096 bytes} [Mon Jul 25 22:50:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:25.508867 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd3e1a-3582-4028-a3da-30b660958fc4 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:25.589047 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:25.607856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd3e1a-3582-4028-a3da-30b660958fc4 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:25.641429 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e6ce7-1556-4033-850c-65a23101c502 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=njrbViEnS82nKWZjIBArXQ, audit_chain_id=['njrbViEnS82nKWZjIBArXQ']) at 0x7f8a0fd5fa30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:25.642147 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e6ce7-1556-4033-850c-65a23101c502 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:25.642575 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e6ce7-1556-4033-850c-65a23101c502 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:25.642856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e6ce7-1556-4033-850c-65a23101c502 None admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:25.643563 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e6ce7-1556-4033-850c-65a23101c502 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:25.643866 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e6ce7-1556-4033-850c-65a23101c502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:25.645224 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e6ce7-1556-4033-850c-65a23101c502 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:25.653091 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 449/898] 10.222.0.47 () {56 vars in 1099 bytes} [Mon Jul 25 22:50:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:25.659558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72728f-795d-49d3-b096-60ecabe73b95 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:25.757099 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72728f-795d-49d3-b096-60ecabe73b95 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:25.791266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3ddb-fd34-470d-a017-d6d0035024c1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=njrbViEnS82nKWZjIBArXQ, audit_chain_id=['njrbViEnS82nKWZjIBArXQ']) at 0x7f8a0fc1de50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:25.791896 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3ddb-fd34-470d-a017-d6d0035024c1 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:25.792183 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3ddb-fd34-470d-a017-d6d0035024c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:25.792461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3ddb-fd34-470d-a017-d6d0035024c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:25.802830 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b3ddb-fd34-470d-a017-d6d0035024c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:25.804277 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b3ddb-fd34-470d-a017-d6d0035024c1 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:25.818841 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-e79b3ddb-fd34-470d-a017-d6d0035024c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:25.818841 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:25.818841 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:25.818841 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:25.818841 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:25.818841 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:25.818841 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:25.818841 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:25.818841 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:25.818841 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:25.818841 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:25.818841 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:25.818841 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:50:25.818841 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:50:25.818841 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:50:25.819864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:50:25.819864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:25.819864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:25.819864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:25.819864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:25.819864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:25.819864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:25.819864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:25.819864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:25.819864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:25.819864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:25.819864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:25.819864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:25.819864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:25.819864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:25.819864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:25.819864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:25.820962 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:50:25.820962 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:50:25.820962 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:25.820962 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:25.820962 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 450/899] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:25.825861 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e6ce7-1556-4033-850c-65a23101c502 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:25.923973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e6ce7-1556-4033-850c-65a23101c502 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:25.956841 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92cfc5-5ede-4094-bf7b-4125dbf7870f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=njrbViEnS82nKWZjIBArXQ, audit_chain_id=['njrbViEnS82nKWZjIBArXQ']) at 0x7f8a0fa0e9d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:25.957447 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92cfc5-5ede-4094-bf7b-4125dbf7870f None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:25.957756 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92cfc5-5ede-4094-bf7b-4125dbf7870f None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:25.958034 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92cfc5-5ede-4094-bf7b-4125dbf7870f None admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:25.958711 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92cfc5-5ede-4094-bf7b-4125dbf7870f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:25.959014 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92cfc5-5ede-4094-bf7b-4125dbf7870f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:25.960355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92cfc5-5ede-4094-bf7b-4125dbf7870f None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:25.972419 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 450/900] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:25.978112 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3ddb-fd34-470d-a017-d6d0035024c1 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:26.006110 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:26.084023 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3ddb-fd34-470d-a017-d6d0035024c1 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:26.117263 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04e433-c815-45a7-91e3-66a73a2b0cfd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=njrbViEnS82nKWZjIBArXQ, audit_chain_id=['njrbViEnS82nKWZjIBArXQ']) at 0x7f8a0fc75850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:26.117928 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04e433-c815-45a7-91e3-66a73a2b0cfd None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:26.118211 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04e433-c815-45a7-91e3-66a73a2b0cfd None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:26.118485 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04e433-c815-45a7-91e3-66a73a2b0cfd None admin] PATH_INFO: `/v3/users/placement` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:26.125717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04e433-c815-45a7-91e3-66a73a2b0cfd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:26.127318 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04e433-c815-45a7-91e3-66a73a2b0cfd None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:26.138518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-8c04e433-c815-45a7-91e3-66a73a2b0cfd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:50:26.138518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:26.138518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:26.138518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:26.138518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:26.138518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:26.138518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:26.138518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:26.138518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:26.138518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:26.138518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:26.138518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:26.138518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:50:26.138518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:50:26.138518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:50:26.138518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:50:26.139427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:26.139427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:26.139427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:50:26.139427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:50:26.139427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:50:26.139427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:50:26.139427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:26.139427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:26.139427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:26.139427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:26.139427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:26.139427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:26.139427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:26.139427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:26.139427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:26.139427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:26.139427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:26.139427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:26.140373 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:26.140373 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:26.140373 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:50:26.140373 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:50:26.140373 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:50:26.140373 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:50:26.140373 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:50:26.140373 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:50:26.140373 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:50:26.140373 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:26.140373 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 451/901] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:50:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:26.146540 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92cfc5-5ede-4094-bf7b-4125dbf7870f None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:26.150291 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:26.245200 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92cfc5-5ede-4094-bf7b-4125dbf7870f None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:26.279384 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d822d8-70a6-46e4-8081-6f8c456ade41 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=njrbViEnS82nKWZjIBArXQ, audit_chain_id=['njrbViEnS82nKWZjIBArXQ']) at 0x7f8a0f9d03d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:26.279987 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d822d8-70a6-46e4-8081-6f8c456ade41 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:26.280270 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d822d8-70a6-46e4-8081-6f8c456ade41 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:26.280544 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d822d8-70a6-46e4-8081-6f8c456ade41 None admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:26.281416 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d822d8-70a6-46e4-8081-6f8c456ade41 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:26.281752 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d822d8-70a6-46e4-8081-6f8c456ade41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:26.283787 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d822d8-70a6-46e4-8081-6f8c456ade41 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:26.300341 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 451/902] 10.222.0.47 () {56 vars in 1143 bytes} [Mon Jul 25 22:50:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:26.306551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04e433-c815-45a7-91e3-66a73a2b0cfd None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:26.391743 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:26.407277 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04e433-c815-45a7-91e3-66a73a2b0cfd None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:26.440503 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbf974-9b3b-48b6-ae6d-7f057629e67a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=njrbViEnS82nKWZjIBArXQ, audit_chain_id=['njrbViEnS82nKWZjIBArXQ']) at 0x7f8a0fbc1a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:26.441112 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbf974-9b3b-48b6-ae6d-7f057629e67a None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:26.441395 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbf974-9b3b-48b6-ae6d-7f057629e67a None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:26.441703 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbf974-9b3b-48b6-ae6d-7f057629e67a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:26.507975 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbf974-9b3b-48b6-ae6d-7f057629e67a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:26.509424 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbf974-9b3b-48b6-ae6d-7f057629e67a None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:26.598460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:26.622880 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 452/903] 10.222.0.47 () {58 vars in 1282 bytes} [Mon Jul 25 22:50:26 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:50:26.629705 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d822d8-70a6-46e4-8081-6f8c456ade41 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:26.690485 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:26.727713 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d822d8-70a6-46e4-8081-6f8c456ade41 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:26.761630 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6420bb7-9fb4-4986-a3a2-26f193cb7b55 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=njrbViEnS82nKWZjIBArXQ, audit_chain_id=['njrbViEnS82nKWZjIBArXQ']) at 0x7f8a0fd148b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:26.762267 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420bb7-9fb4-4986-a3a2-26f193cb7b55 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:26.762552 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420bb7-9fb4-4986-a3a2-26f193cb7b55 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:26.762829 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420bb7-9fb4-4986-a3a2-26f193cb7b55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:26.772780 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6420bb7-9fb4-4986-a3a2-26f193cb7b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:26.774242 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6420bb7-9fb4-4986-a3a2-26f193cb7b55 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:26.788458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-d6420bb7-9fb4-4986-a3a2-26f193cb7b55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:26.788458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:26.788458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:26.788458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:26.788458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:26.788458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:26.788458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:26.788458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:26.788458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:26.788458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:26.788458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:26.788458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:26.788458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:50:26.788458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:50:26.788458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:50:26.789474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:50:26.789474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:26.789474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:26.789474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:26.789474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:26.789474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:26.789474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:26.789474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:26.789474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:26.789474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:26.789474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:26.789474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:26.789474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:26.789474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:26.789474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:26.789474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:26.789474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:26.790580 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:50:26.790580 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:50:26.790580 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:50:26.790580 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:50:26.790580 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 452/904] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:26.795768 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbf974-9b3b-48b6-ae6d-7f057629e67a None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:26.892449 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbf974-9b3b-48b6-ae6d-7f057629e67a None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:26.925709 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b24b8-cf31-4daf-be1a-631970f5fa56 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=njrbViEnS82nKWZjIBArXQ, audit_chain_id=['njrbViEnS82nKWZjIBArXQ']) at 0x7f8a0fe25280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:26.926319 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b24b8-cf31-4daf-be1a-631970f5fa56 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:26.926602 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b24b8-cf31-4daf-be1a-631970f5fa56 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:26.926876 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b24b8-cf31-4daf-be1a-631970f5fa56 None admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:26.927553 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b24b8-cf31-4daf-be1a-631970f5fa56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:26.927858 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b24b8-cf31-4daf-be1a-631970f5fa56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:26.929237 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b24b8-cf31-4daf-be1a-631970f5fa56 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:26.940885 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 453/905] 10.222.0.47 () {56 vars in 1109 bytes} [Mon Jul 25 22:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:26.946581 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6420bb7-9fb4-4986-a3a2-26f193cb7b55 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:27.047903 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6420bb7-9fb4-4986-a3a2-26f193cb7b55 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:27.061571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:27.081086 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f6ecf-2f60-4fde-99fc-737a5149c4e5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=njrbViEnS82nKWZjIBArXQ, audit_chain_id=['njrbViEnS82nKWZjIBArXQ']) at 0x7f8a0fd14580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:27.081750 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f6ecf-2f60-4fde-99fc-737a5149c4e5 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:27.082031 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f6ecf-2f60-4fde-99fc-737a5149c4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:27.082304 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f6ecf-2f60-4fde-99fc-737a5149c4e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:27.088718 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f6ecf-2f60-4fde-99fc-737a5149c4e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:27.090183 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f6ecf-2f60-4fde-99fc-737a5149c4e5 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:27.101817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application [None req-f79f6ecf-2f60-4fde-99fc-737a5149c4e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:50:27.101817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:27.101817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:27.101817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:27.101817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:27.101817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:27.101817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:27.101817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:27.101817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:27.101817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:27.101817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:27.101817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:27.101817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:50:27.101817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:50:27.101817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:50:27.102848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:50:27.102848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:27.102848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:27.102848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:27.102848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:27.102848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:27.102848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:27.102848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:27.102848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:27.102848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:27.102848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:27.102848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:27.102848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:27.102848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:27.102848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:27.102848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:27.102848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:27.104132 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:50:27.104132 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:50:27.104132 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:50:27.104132 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:50:27.104132 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:50:27.104132 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:50:27.104132 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:50:27.104132 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: ERROR keystone.server.flask.application Jul 25 22:50:27.104132 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 453/906] 10.222.0.47 () {56 vars in 1111 bytes} [Mon Jul 25 22:50:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:27.108857 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b24b8-cf31-4daf-be1a-631970f5fa56 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:27.155944 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:27.208569 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b24b8-cf31-4daf-be1a-631970f5fa56 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:27.241880 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09e740-ffbb-46ca-93cf-dcaa931ed8c9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=njrbViEnS82nKWZjIBArXQ, audit_chain_id=['njrbViEnS82nKWZjIBArXQ']) at 0x7f8a0fd66640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:27.242495 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09e740-ffbb-46ca-93cf-dcaa931ed8c9 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:27.242784 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09e740-ffbb-46ca-93cf-dcaa931ed8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:27.243059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09e740-ffbb-46ca-93cf-dcaa931ed8c9 None admin] PATH_INFO: `/v3/projects` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:27.243796 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09e740-ffbb-46ca-93cf-dcaa931ed8c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:27.244105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09e740-ffbb-46ca-93cf-dcaa931ed8c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:27.245531 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09e740-ffbb-46ca-93cf-dcaa931ed8c9 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:27.257266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 454/907] 10.222.0.47 () {56 vars in 1148 bytes} [Mon Jul 25 22:50:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:27.263683 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f6ecf-2f60-4fde-99fc-737a5149c4e5 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:27.362406 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f6ecf-2f60-4fde-99fc-737a5149c4e5 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:27.394939 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366b848-346c-450b-8304-ee48d0c4ec03 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=njrbViEnS82nKWZjIBArXQ, audit_chain_id=['njrbViEnS82nKWZjIBArXQ']) at 0x7f8a0fcb2d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:27.395545 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366b848-346c-450b-8304-ee48d0c4ec03 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:27.395832 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366b848-346c-450b-8304-ee48d0c4ec03 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:27.396111 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366b848-346c-450b-8304-ee48d0c4ec03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:27.396954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366b848-346c-450b-8304-ee48d0c4ec03 None admin] RBAC: Adding query filter params (role.id=6ca03befbf3a456eae350bc7e583488f, scope.project.id=2d1b44363d694c60867ec29af4f9d01e, user.id=530c96407340435c982fd99367689007) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:27.397271 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366b848-346c-450b-8304-ee48d0c4ec03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:27.398728 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366b848-346c-450b-8304-ee48d0c4ec03 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:27.404401 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 454/908] 10.222.0.47 () {56 vars in 1374 bytes} [Mon Jul 25 22:50:27 2022] GET /identity/v3/role_assignments?user.id=530c96407340435c982fd99367689007&scope.project.id=2d1b44363d694c60867ec29af4f9d01e&role.id=6ca03befbf3a456eae350bc7e583488f => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:29.671363 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f8f33-6445-4bcc-8168-cfdda3e4810b None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:29.671907 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f8f33-6445-4bcc-8168-cfdda3e4810b None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:29.672074 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f8f33-6445-4bcc-8168-cfdda3e4810b None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:29.674433 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 455/909] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:50:29.679630 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f216b-dcbb-4a25-a753-3a8c53ad544d None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:29.680053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f216b-dcbb-4a25-a753-3a8c53ad544d None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:29.680197 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f216b-dcbb-4a25-a753-3a8c53ad544d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:29.698875 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-c74f216b-dcbb-4a25-a753-3a8c53ad544d None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:50:29.700050 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-c74f216b-dcbb-4a25-a753-3a8c53ad544d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:29.728616 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:29.765943 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 455/910] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:50:29 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:50:29.788639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f8f33-6445-4bcc-8168-cfdda3e4810b None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:29.888611 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f8f33-6445-4bcc-8168-cfdda3e4810b None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:29.896337 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:29.923369 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc69f8a-7ff0-4159-8ece-b6954291e2a3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qgIw7QgeQe6EX5-aLVconA, audit_chain_id=['qgIw7QgeQe6EX5-aLVconA']) at 0x7f8a0fc1dee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:29.924003 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc69f8a-7ff0-4159-8ece-b6954291e2a3 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:29.924292 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc69f8a-7ff0-4159-8ece-b6954291e2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:29.924572 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc69f8a-7ff0-4159-8ece-b6954291e2a3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:29.925197 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc69f8a-7ff0-4159-8ece-b6954291e2a3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:29.926623 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc69f8a-7ff0-4159-8ece-b6954291e2a3 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:29.935490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-1fc69f8a-7ff0-4159-8ece-b6954291e2a3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:50:29.935490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:29.935490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:50:29.935490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:50:29.935490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:50:29.935490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:50:29.935490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:50:29.935490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:50:29.935490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:50:29.935490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:29.935490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:50:29.935490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:29.935490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:29.935490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:29.935490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:29.935490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:29.935490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:29.936684 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:29.936684 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:29.936684 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:29.936684 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:29.936684 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:29.936684 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:29.936684 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:50:29.936684 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:50:29.936684 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:50:29.936684 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:50:29.936684 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:29.936684 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:29.936684 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:29.936684 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:29.936684 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:29.936684 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:29.937525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:29.937525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:29.937525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:29.937525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:29.937525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:29.937525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:29.937525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:29.937525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:29.937525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:29.937525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:29.937525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:50:29.937525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:50:29.937525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:50:29.937525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:29.937525 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 456/911] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Jul 25 22:50:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:29.942920 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f216b-dcbb-4a25-a753-3a8c53ad544d None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:30.048331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f216b-dcbb-4a25-a753-3a8c53ad544d None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:30.086760 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7208c2-766c-4114-81fa-e9d810d90823 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qgIw7QgeQe6EX5-aLVconA, audit_chain_id=['qgIw7QgeQe6EX5-aLVconA']) at 0x7f8a0fdda610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:30.087379 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7208c2-766c-4114-81fa-e9d810d90823 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:30.087660 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7208c2-766c-4114-81fa-e9d810d90823 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:30.087935 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7208c2-766c-4114-81fa-e9d810d90823 None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:30.088606 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7208c2-766c-4114-81fa-e9d810d90823 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:30.088913 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7208c2-766c-4114-81fa-e9d810d90823 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:30.090303 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7208c2-766c-4114-81fa-e9d810d90823 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:30.095176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 456/912] 10.222.0.47 () {56 vars in 1116 bytes} [Mon Jul 25 22:50:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:30.101090 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc69f8a-7ff0-4159-8ece-b6954291e2a3 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:30.200650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc69f8a-7ff0-4159-8ece-b6954291e2a3 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:30.233466 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c7f99-58f4-442a-a60f-1784f80ff557 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qgIw7QgeQe6EX5-aLVconA, audit_chain_id=['qgIw7QgeQe6EX5-aLVconA']) at 0x7f8a0fc3e610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:30.234112 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c7f99-58f4-442a-a60f-1784f80ff557 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:30.234396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c7f99-58f4-442a-a60f-1784f80ff557 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:30.234680 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c7f99-58f4-442a-a60f-1784f80ff557 None admin] PATH_INFO: `/v3/services` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:30.235347 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c7f99-58f4-442a-a60f-1784f80ff557 None admin] RBAC: Adding query filter params (type=placement) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:30.236275 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c7f99-58f4-442a-a60f-1784f80ff557 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:30.237658 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c7f99-58f4-442a-a60f-1784f80ff557 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:30.241979 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 457/913] 10.222.0.47 () {56 vars in 1116 bytes} [Mon Jul 25 22:50:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:32.454780 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43514db2-67bf-4449-a327-d221caa42430 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:32.455348 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43514db2-67bf-4449-a327-d221caa42430 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:32.455348 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43514db2-67bf-4449-a327-d221caa42430 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:32.456694 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 457/914] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:50:32.462491 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c583f-562c-4cbf-90e4-c3cc5a113a2d None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:32.462911 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c583f-562c-4cbf-90e4-c3cc5a113a2d None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:32.463061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c583f-562c-4cbf-90e4-c3cc5a113a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:32.480962 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-933c583f-562c-4cbf-90e4-c3cc5a113a2d None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:50:32.482208 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-933c583f-562c-4cbf-90e4-c3cc5a113a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:32.510063 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:32.551938 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 458/915] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:50:32 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:50:32.575874 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43514db2-67bf-4449-a327-d221caa42430 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:32.609109 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:32.681345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43514db2-67bf-4449-a327-d221caa42430 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:32.714511 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385fb6e-936a-4c54-9cab-65a42a5ba5f1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6kcBcvmLQ6iHTfs5DKz6Fw, audit_chain_id=['6kcBcvmLQ6iHTfs5DKz6Fw']) at 0x7f8a0fa6f7c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:32.715057 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385fb6e-936a-4c54-9cab-65a42a5ba5f1 None admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:32.715338 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385fb6e-936a-4c54-9cab-65a42a5ba5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:32.715610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385fb6e-936a-4c54-9cab-65a42a5ba5f1 None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:32.716285 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385fb6e-936a-4c54-9cab-65a42a5ba5f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:32.717654 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385fb6e-936a-4c54-9cab-65a42a5ba5f1 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:32.732122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 458/916] 10.222.0.47 () {60 vars in 1141 bytes} [Mon Jul 25 22:50:32 2022] POST /identity/v3/services => generated 246 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:50:34.935975 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd47f9-0744-47c1-be52-ccdf59639905 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:34.936509 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd47f9-0744-47c1-be52-ccdf59639905 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:34.936509 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd47f9-0744-47c1-be52-ccdf59639905 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:34.937995 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 459/917] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:50:34.943205 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eec2a4-4503-431d-b660-75bf90ba609c None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:34.943589 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eec2a4-4503-431d-b660-75bf90ba609c None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:34.943772 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eec2a4-4503-431d-b660-75bf90ba609c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:34.962036 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-d7eec2a4-4503-431d-b660-75bf90ba609c None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:50:34.963215 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-d7eec2a4-4503-431d-b660-75bf90ba609c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:35.036131 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 459/918] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:50:34 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:50:35.059852 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd47f9-0744-47c1-be52-ccdf59639905 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:35.158403 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd47f9-0744-47c1-be52-ccdf59639905 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:35.190963 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda288c0-5272-4a52-92a0-7c9b592d4bf1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qcfPAiEIRJ6bI3y2bkUQbw, audit_chain_id=['qcfPAiEIRJ6bI3y2bkUQbw']) at 0x7f8a0fc64700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:35.191544 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda288c0-5272-4a52-92a0-7c9b592d4bf1 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:35.191826 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda288c0-5272-4a52-92a0-7c9b592d4bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:35.192104 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda288c0-5272-4a52-92a0-7c9b592d4bf1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:35.192726 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda288c0-5272-4a52-92a0-7c9b592d4bf1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:35.194127 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda288c0-5272-4a52-92a0-7c9b592d4bf1 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:35.202779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-fda288c0-5272-4a52-92a0-7c9b592d4bf1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:50:35.202779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:35.202779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:50:35.202779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:50:35.202779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:50:35.202779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:50:35.202779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:50:35.202779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:50:35.202779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:50:35.202779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:35.202779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:50:35.202779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:35.202779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:35.202779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:35.202779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:35.202779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:35.202779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:35.204408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:35.204408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:35.204408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:35.204408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:35.204408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:35.204408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:35.204408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:50:35.204408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:50:35.204408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:50:35.204408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:50:35.204408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:35.204408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:35.204408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:35.204408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:35.204408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:35.204408 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:35.205666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:35.205666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:35.205666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:35.205666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:35.205666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:35.205666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:35.205666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:35.205666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:35.205666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:35.205666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:35.205666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:50:35.205666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:50:35.205666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:50:35.205666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:35.205666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 460/919] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Jul 25 22:50:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:35.210357 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eec2a4-4503-431d-b660-75bf90ba609c None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:35.228949 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:35.308315 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eec2a4-4503-431d-b660-75bf90ba609c None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:35.341962 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4ef4e-1287-4f24-bb83-f8002a6ce9c4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qcfPAiEIRJ6bI3y2bkUQbw, audit_chain_id=['qcfPAiEIRJ6bI3y2bkUQbw']) at 0x7f8a0fd5f1f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:35.342573 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4ef4e-1287-4f24-bb83-f8002a6ce9c4 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:35.342855 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4ef4e-1287-4f24-bb83-f8002a6ce9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:35.343126 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4ef4e-1287-4f24-bb83-f8002a6ce9c4 None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:35.343794 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4ef4e-1287-4f24-bb83-f8002a6ce9c4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:35.344095 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4ef4e-1287-4f24-bb83-f8002a6ce9c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:35.345485 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4ef4e-1287-4f24-bb83-f8002a6ce9c4 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:35.350411 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 460/920] 10.222.0.47 () {56 vars in 1116 bytes} [Mon Jul 25 22:50:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:35.356353 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda288c0-5272-4a52-92a0-7c9b592d4bf1 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:35.384712 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:35.457418 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda288c0-5272-4a52-92a0-7c9b592d4bf1 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:35.490728 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ee2e5-2b6a-4b98-a9d2-26e9509f3003 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qcfPAiEIRJ6bI3y2bkUQbw, audit_chain_id=['qcfPAiEIRJ6bI3y2bkUQbw']) at 0x7f8a0fbc1580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:35.491349 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ee2e5-2b6a-4b98-a9d2-26e9509f3003 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:35.491629 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ee2e5-2b6a-4b98-a9d2-26e9509f3003 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:35.491901 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ee2e5-2b6a-4b98-a9d2-26e9509f3003 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:35.492643 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ee2e5-2b6a-4b98-a9d2-26e9509f3003 None admin] RBAC: Adding query filter params (interface=public, service_id=815a12e67ec24cb881137cd078a30e0e, region_id=RegionOne) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:35.493047 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ee2e5-2b6a-4b98-a9d2-26e9509f3003 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:35.494420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ee2e5-2b6a-4b98-a9d2-26e9509f3003 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:35.499297 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 461/921] 10.222.0.47 () {56 vars in 1251 bytes} [Mon Jul 25 22:50:35 2022] GET /identity/v3/endpoints?service_id=815a12e67ec24cb881137cd078a30e0e&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:35.505821 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4ef4e-1287-4f24-bb83-f8002a6ce9c4 None admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:35.587621 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:35.605122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4ef4e-1287-4f24-bb83-f8002a6ce9c4 None admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:35.639062 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66581034-df99-4d52-b474-841db2d6f5f8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qcfPAiEIRJ6bI3y2bkUQbw, audit_chain_id=['qcfPAiEIRJ6bI3y2bkUQbw']) at 0x7f8a0fa6fa30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:35.639678 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66581034-df99-4d52-b474-841db2d6f5f8 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:35.639958 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66581034-df99-4d52-b474-841db2d6f5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:35.640229 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66581034-df99-4d52-b474-841db2d6f5f8 None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:35.640865 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66581034-df99-4d52-b474-841db2d6f5f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:35.643558 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66581034-df99-4d52-b474-841db2d6f5f8 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:35.650253 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 461/922] 10.222.0.47 () {56 vars in 1087 bytes} [Mon Jul 25 22:50:35 2022] GET /identity/v3/services => generated 1962 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:50:37.827369 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d669b-19ff-4ecc-a660-6dbd8c867372 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:37.827913 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d669b-19ff-4ecc-a660-6dbd8c867372 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:37.827913 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d669b-19ff-4ecc-a660-6dbd8c867372 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:37.830081 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 462/923] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:50:37.835160 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f4cb4-835a-4bda-8318-6ec92f30dcf7 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:37.835596 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f4cb4-835a-4bda-8318-6ec92f30dcf7 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:37.835723 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f4cb4-835a-4bda-8318-6ec92f30dcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:37.853609 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-ab8f4cb4-835a-4bda-8318-6ec92f30dcf7 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:50:37.854810 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-ab8f4cb4-835a-4bda-8318-6ec92f30dcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:37.920173 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 462/924] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:50:37 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:50:37.944966 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d669b-19ff-4ecc-a660-6dbd8c867372 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:38.035998 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:38.045658 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d669b-19ff-4ecc-a660-6dbd8c867372 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:38.079659 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c1166-e8cd-4d41-9cda-658441cdef85 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T3v7IlXGQnO5L4VPhzp4iQ, audit_chain_id=['T3v7IlXGQnO5L4VPhzp4iQ']) at 0x7f8a0fbc1dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:38.080239 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c1166-e8cd-4d41-9cda-658441cdef85 None admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:38.080521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c1166-e8cd-4d41-9cda-658441cdef85 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:38.080798 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c1166-e8cd-4d41-9cda-658441cdef85 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:38.081416 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c1166-e8cd-4d41-9cda-658441cdef85 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:38.082811 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c1166-e8cd-4d41-9cda-658441cdef85 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:38.091499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application [None req-f14c1166-e8cd-4d41-9cda-658441cdef85 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:50:38.091499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:38.091499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:50:38.091499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:50:38.091499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:50:38.091499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:50:38.091499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:50:38.091499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:50:38.091499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:50:38.091499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:38.091499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:50:38.091499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:38.091499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:50:38.091499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:50:38.091499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:50:38.091499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:50:38.091499 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:50:38.092650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:50:38.092650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:50:38.092650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:50:38.092650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:50:38.092650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:50:38.092650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:50:38.092650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:50:38.092650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:50:38.092650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:50:38.092650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:50:38.092650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:50:38.092650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:50:38.092650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:50:38.092650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:50:38.092650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:50:38.092650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:50:38.093714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:50:38.093714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application with Lock( Jul 25 22:50:38.093714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:50:38.093714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:50:38.093714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:50:38.093714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:50:38.093714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:50:38.093714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:50:38.093714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:50:38.093714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:50:38.093714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:50:38.093714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:50:38.093714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:50:38.093714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: ERROR keystone.server.flask.application Jul 25 22:50:38.093714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 463/925] 10.222.0.47 () {56 vars in 1117 bytes} [Mon Jul 25 22:50:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:50:38.098818 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f4cb4-835a-4bda-8318-6ec92f30dcf7 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:38.173697 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:38.196586 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f4cb4-835a-4bda-8318-6ec92f30dcf7 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:38.228881 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d10211-a1b8-42a9-be28-1ed357788348 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T3v7IlXGQnO5L4VPhzp4iQ, audit_chain_id=['T3v7IlXGQnO5L4VPhzp4iQ']) at 0x7f8a0fc9f460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:38.229490 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d10211-a1b8-42a9-be28-1ed357788348 None admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:38.229812 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d10211-a1b8-42a9-be28-1ed357788348 None admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:38.230088 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d10211-a1b8-42a9-be28-1ed357788348 None admin] PATH_INFO: `/v3/services` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:38.230759 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d10211-a1b8-42a9-be28-1ed357788348 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:50:38.231064 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d10211-a1b8-42a9-be28-1ed357788348 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:38.232422 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d10211-a1b8-42a9-be28-1ed357788348 None admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:38.238207 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 463/926] 10.222.0.47 () {56 vars in 1116 bytes} [Mon Jul 25 22:50:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:38.244042 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c1166-e8cd-4d41-9cda-658441cdef85 None admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:38.341038 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c1166-e8cd-4d41-9cda-658441cdef85 None admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:38.375849 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82155050-3b59-421d-9170-224dd30d0425 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T3v7IlXGQnO5L4VPhzp4iQ, audit_chain_id=['T3v7IlXGQnO5L4VPhzp4iQ']) at 0x7f8a0fbc48e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:38.376448 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82155050-3b59-421d-9170-224dd30d0425 None admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:38.376737 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82155050-3b59-421d-9170-224dd30d0425 None admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:38.377012 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82155050-3b59-421d-9170-224dd30d0425 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:38.377747 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82155050-3b59-421d-9170-224dd30d0425 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:38.379102 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82155050-3b59-421d-9170-224dd30d0425 None admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:38.398058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 464/927] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 22:50:38 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:50:48.234594 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=30 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:48.394278 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:51:36.761908 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3bf23-9f59-4154-a37a-a4c14f2ddaf6 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:36.762499 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3bf23-9f59-4154-a37a-a4c14f2ddaf6 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:36.762499 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3bf23-9f59-4154-a37a-a4c14f2ddaf6 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:36.770912 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474363c-26b7-46f9-9f53-b8182b02e097 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:36.771462 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 464/928] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:51:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:51:36.771553 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474363c-26b7-46f9-9f53-b8182b02e097 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:36.771715 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474363c-26b7-46f9-9f53-b8182b02e097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:36.794035 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-5474363c-26b7-46f9-9f53-b8182b02e097 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:36.796752 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-5474363c-26b7-46f9-9f53-b8182b02e097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:36.877733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 465/929] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:51:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:51:36.926968 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753d905-8f2f-4596-bed9-7b6c1de28a22 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:36.933016 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753d905-8f2f-4596-bed9-7b6c1de28a22 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:36.933347 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753d905-8f2f-4596-bed9-7b6c1de28a22 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:36.937847 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 465/930] 10.222.0.47 () {54 vars in 965 bytes} [Mon Jul 25 22:51:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:51:36.945714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc090605-68ca-4a27-977c-3bdf3ecc8097 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:36.946123 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc090605-68ca-4a27-977c-3bdf3ecc8097 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:36.946481 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc090605-68ca-4a27-977c-3bdf3ecc8097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:37.003818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-bc090605-68ca-4a27-977c-3bdf3ecc8097 None None] MFA Rules not processed for user `f77ef50984084af9bcd220fc68deacf8`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:37.004950 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-bc090605-68ca-4a27-977c-3bdf3ecc8097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:37.089409 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 466/931] 10.222.0.47 () {58 vars in 1062 bytes} [Mon Jul 25 22:51:36 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:51:37.098052 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753d905-8f2f-4596-bed9-7b6c1de28a22 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:37.111825 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753d905-8f2f-4596-bed9-7b6c1de28a22 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:37.115186 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6cbcf-821d-45d7-9b6b-897b17b89b81 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fc87310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:37.115744 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6cbcf-821d-45d7-9b6b-897b17b89b81 service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:37.116186 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6cbcf-821d-45d7-9b6b-897b17b89b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:37.116351 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6cbcf-821d-45d7-9b6b-897b17b89b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:37.126459 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6cbcf-821d-45d7-9b6b-897b17b89b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:37.127908 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6cbcf-821d-45d7-9b6b-897b17b89b81 service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:37.146367 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 466/932] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:51:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:51:39.643573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0ebe1-ba04-44dc-9e6a-6a51e11b498b None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:39.644125 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0ebe1-ba04-44dc-9e6a-6a51e11b498b None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:39.644125 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0ebe1-ba04-44dc-9e6a-6a51e11b498b None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:39.645475 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 467/933] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:51:39.650516 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1169-f700-4a64-b161-73e92976669f None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:39.650916 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1169-f700-4a64-b161-73e92976669f None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:39.651078 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1169-f700-4a64-b161-73e92976669f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:39.672380 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-202a1169-f700-4a64-b161-73e92976669f None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:39.673550 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-202a1169-f700-4a64-b161-73e92976669f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:39.681174 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 467/934] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:51:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:51:39.720382 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0ebe1-ba04-44dc-9e6a-6a51e11b498b None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:39.730975 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0ebe1-ba04-44dc-9e6a-6a51e11b498b None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:39.735155 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfd683-6551-4e93-bc5c-41d00536e42d service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fd88c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:39.735794 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfd683-6551-4e93-bc5c-41d00536e42d service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:39.736079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfd683-6551-4e93-bc5c-41d00536e42d service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:39.736355 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfd683-6551-4e93-bc5c-41d00536e42d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:39.746185 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfd683-6551-4e93-bc5c-41d00536e42d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:39.747637 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfd683-6551-4e93-bc5c-41d00536e42d service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:39.758039 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 468/935] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:51:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:51:42.372044 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5510afd-fd68-453f-9efd-31e1d6673466 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:42.372578 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5510afd-fd68-453f-9efd-31e1d6673466 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:42.372578 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5510afd-fd68-453f-9efd-31e1d6673466 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:42.374671 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 468/936] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:51:42.379937 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e863098-7698-4a33-982a-0f9f6e0aa208 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:42.380360 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e863098-7698-4a33-982a-0f9f6e0aa208 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:42.380592 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e863098-7698-4a33-982a-0f9f6e0aa208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:42.419285 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-5e863098-7698-4a33-982a-0f9f6e0aa208 None None] MFA Rules not processed for user `e088deb3ffe740c48565d7c35c2e9bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:42.421095 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-5e863098-7698-4a33-982a-0f9f6e0aa208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:42.470064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:51:42.502233 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 469/937] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:51:42 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:51:42.543317 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5510afd-fd68-453f-9efd-31e1d6673466 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:42.554907 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5510afd-fd68-453f-9efd-31e1d6673466 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:42.558426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c3c46-89b0-44f4-ba38-419f8aaf7ad9 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fc495b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:42.559128 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c3c46-89b0-44f4-ba38-419f8aaf7ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:42.559483 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c3c46-89b0-44f4-ba38-419f8aaf7ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:42.559830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c3c46-89b0-44f4-ba38-419f8aaf7ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:42.570465 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c3c46-89b0-44f4-ba38-419f8aaf7ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:42.572137 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c3c46-89b0-44f4-ba38-419f8aaf7ad9 service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:42.582310 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 469/938] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:51:42 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:51:45.474788 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd3b27-b73c-49a0-81bd-e1562d86ecfb None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:45.475300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd3b27-b73c-49a0-81bd-e1562d86ecfb None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:45.475412 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd3b27-b73c-49a0-81bd-e1562d86ecfb None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:45.476874 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 470/939] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:51:45.482042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493e0d3-205b-4a25-bb92-5314aaaf17bd None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:45.482563 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493e0d3-205b-4a25-bb92-5314aaaf17bd None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:45.482782 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493e0d3-205b-4a25-bb92-5314aaaf17bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:45.504231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-1493e0d3-205b-4a25-bb92-5314aaaf17bd None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:45.505439 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-1493e0d3-205b-4a25-bb92-5314aaaf17bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:45.580789 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 470/940] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:51:45 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:51:45.620581 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd3b27-b73c-49a0-81bd-e1562d86ecfb None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:45.631880 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd3b27-b73c-49a0-81bd-e1562d86ecfb None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:45.635654 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3a797-9196-446c-be6c-78f6bc4a4127 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fc75310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:45.636341 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3a797-9196-446c-be6c-78f6bc4a4127 service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:45.636688 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3a797-9196-446c-be6c-78f6bc4a4127 service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:45.637022 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3a797-9196-446c-be6c-78f6bc4a4127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:45.646791 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3a797-9196-446c-be6c-78f6bc4a4127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:45.648306 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3a797-9196-446c-be6c-78f6bc4a4127 service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:45.658228 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 471/941] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:51:45 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:51:48.565127 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e4435-98a9-4c55-a904-e150b2cbe8a2 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:48.565678 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e4435-98a9-4c55-a904-e150b2cbe8a2 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:48.565814 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e4435-98a9-4c55-a904-e150b2cbe8a2 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:48.567190 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 471/942] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:51:48.572441 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bc22a-6a11-40b5-933b-c4f312a7d1b1 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:48.572882 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bc22a-6a11-40b5-933b-c4f312a7d1b1 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:48.573005 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bc22a-6a11-40b5-933b-c4f312a7d1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:48.593932 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-a59bc22a-6a11-40b5-933b-c4f312a7d1b1 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:48.595181 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-a59bc22a-6a11-40b5-933b-c4f312a7d1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:48.603372 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 472/943] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:51:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:51:48.653214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b06af-b588-4b12-b645-ce31ef045d74 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:48.653506 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b06af-b588-4b12-b645-ce31ef045d74 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:48.654345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b06af-b588-4b12-b645-ce31ef045d74 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:48.655874 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 472/944] 10.222.0.47 () {54 vars in 965 bytes} [Mon Jul 25 22:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:51:48.661743 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43da49b-1d8e-40dc-9c6e-4d765aefa5f1 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:48.662107 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43da49b-1d8e-40dc-9c6e-4d765aefa5f1 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:48.662452 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43da49b-1d8e-40dc-9c6e-4d765aefa5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:48.682287 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-b43da49b-1d8e-40dc-9c6e-4d765aefa5f1 None None] MFA Rules not processed for user `f77ef50984084af9bcd220fc68deacf8`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:48.683467 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-b43da49b-1d8e-40dc-9c6e-4d765aefa5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:48.690198 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 473/945] 10.222.0.47 () {58 vars in 1062 bytes} [Mon Jul 25 22:51:48 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:51:48.699039 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b06af-b588-4b12-b645-ce31ef045d74 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:48.709635 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b06af-b588-4b12-b645-ce31ef045d74 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:48.713034 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49692a7-8f43-4894-a7f5-4eccbe1f88f7 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a0fd5f700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:48.713714 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49692a7-8f43-4894-a7f5-4eccbe1f88f7 service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:48.714036 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49692a7-8f43-4894-a7f5-4eccbe1f88f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:48.714313 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49692a7-8f43-4894-a7f5-4eccbe1f88f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:48.723643 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49692a7-8f43-4894-a7f5-4eccbe1f88f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:48.725064 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49692a7-8f43-4894-a7f5-4eccbe1f88f7 service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:48.735191 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 473/946] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:51:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:51:51.228540 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e6faf-b6c7-4730-a89d-98bf24962d80 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:51.229079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e6faf-b6c7-4730-a89d-98bf24962d80 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:51.229079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e6faf-b6c7-4730-a89d-98bf24962d80 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:51.230480 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 474/947] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:51:51.236235 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa129813-8600-41e3-a2e9-882be223a127 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:51.236651 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa129813-8600-41e3-a2e9-882be223a127 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:51.237058 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa129813-8600-41e3-a2e9-882be223a127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:51.256949 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-fa129813-8600-41e3-a2e9-882be223a127 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:51.258171 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-fa129813-8600-41e3-a2e9-882be223a127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:51.266497 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 474/948] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:51:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:51:51.304847 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e6faf-b6c7-4730-a89d-98bf24962d80 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:51.316750 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e6faf-b6c7-4730-a89d-98bf24962d80 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:51.320145 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f7390e-b860-48f4-859c-502c599994a8 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a0fca78b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:51.320746 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7390e-b860-48f4-859c-502c599994a8 service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:51.321025 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7390e-b860-48f4-859c-502c599994a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:51.321300 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7390e-b860-48f4-859c-502c599994a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:51.330484 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7390e-b860-48f4-859c-502c599994a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:51.331898 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f7390e-b860-48f4-859c-502c599994a8 service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:51.341863 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 475/949] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:51:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:51:53.695644 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b239f9-8abf-4a13-9620-47514d6f3ef3 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:53.696252 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b239f9-8abf-4a13-9620-47514d6f3ef3 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:53.696252 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b239f9-8abf-4a13-9620-47514d6f3ef3 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:53.697541 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 475/950] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:51:53.703538 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ea2e1-189a-47e2-a99d-93e65a922d7f None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:53.704057 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ea2e1-189a-47e2-a99d-93e65a922d7f None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:53.704223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ea2e1-189a-47e2-a99d-93e65a922d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:53.727332 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-c28ea2e1-189a-47e2-a99d-93e65a922d7f None None] MFA Rules not processed for user `e088deb3ffe740c48565d7c35c2e9bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:53.728583 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-c28ea2e1-189a-47e2-a99d-93e65a922d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:53.737365 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 476/951] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:51:53 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:51:53.775611 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b239f9-8abf-4a13-9620-47514d6f3ef3 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:53.786659 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b239f9-8abf-4a13-9620-47514d6f3ef3 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:53.790101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2128a-84da-43bd-b68a-75a4b6a77aaa service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a0fcb2e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:53.790799 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2128a-84da-43bd-b68a-75a4b6a77aaa service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:53.791141 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2128a-84da-43bd-b68a-75a4b6a77aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:53.791480 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2128a-84da-43bd-b68a-75a4b6a77aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:53.800348 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2128a-84da-43bd-b68a-75a4b6a77aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:53.801812 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2128a-84da-43bd-b68a-75a4b6a77aaa service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:53.811468 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 476/952] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:51:53 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:51:56.473523 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da5145-517e-4c91-abf4-dff5e346b45a None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:56.474081 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da5145-517e-4c91-abf4-dff5e346b45a None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:56.474081 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da5145-517e-4c91-abf4-dff5e346b45a None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:56.475520 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 477/953] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:51:56.480899 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e6b8f-73e5-4c2a-9faf-913ae2f775d9 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:56.481914 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e6b8f-73e5-4c2a-9faf-913ae2f775d9 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:56.482162 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e6b8f-73e5-4c2a-9faf-913ae2f775d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:56.501664 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-922e6b8f-73e5-4c2a-9faf-913ae2f775d9 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:56.502856 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-922e6b8f-73e5-4c2a-9faf-913ae2f775d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:56.510835 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 477/954] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:51:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:51:56.547906 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da5145-517e-4c91-abf4-dff5e346b45a None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:56.558523 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da5145-517e-4c91-abf4-dff5e346b45a None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:56.562916 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843f967-aa3c-4a08-a6cd-1ee1706d63f6 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fd6f9a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:56.563522 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843f967-aa3c-4a08-a6cd-1ee1706d63f6 service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:56.563801 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843f967-aa3c-4a08-a6cd-1ee1706d63f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:56.564072 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843f967-aa3c-4a08-a6cd-1ee1706d63f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:56.572923 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843f967-aa3c-4a08-a6cd-1ee1706d63f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:56.574386 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843f967-aa3c-4a08-a6cd-1ee1706d63f6 service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:56.583894 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 478/955] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:51:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:51:58.877762 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df072d10-f973-4a0c-96cb-f01314d59a35 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:58.878323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df072d10-f973-4a0c-96cb-f01314d59a35 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:58.878323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df072d10-f973-4a0c-96cb-f01314d59a35 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:58.879657 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 478/956] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:51:58.885072 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc05c4c-9f87-414e-9175-3381c3d71d6d None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:58.885520 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc05c4c-9f87-414e-9175-3381c3d71d6d None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:58.885684 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc05c4c-9f87-414e-9175-3381c3d71d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:58.905391 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-dbc05c4c-9f87-414e-9175-3381c3d71d6d None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:58.906554 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-dbc05c4c-9f87-414e-9175-3381c3d71d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:58.914423 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 479/957] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:51:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:51:58.956214 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df072d10-f973-4a0c-96cb-f01314d59a35 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:58.961565 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=65 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:51:58.968297 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df072d10-f973-4a0c-96cb-f01314d59a35 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:58.971801 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f357d-4f99-4c4d-9fbd-88428ee54d97 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fe3adc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:58.972427 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f357d-4f99-4c4d-9fbd-88428ee54d97 service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:58.972706 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f357d-4f99-4c4d-9fbd-88428ee54d97 service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:58.972980 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f357d-4f99-4c4d-9fbd-88428ee54d97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:58.982019 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f357d-4f99-4c4d-9fbd-88428ee54d97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:58.983448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f357d-4f99-4c4d-9fbd-88428ee54d97 service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:58.992591 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 479/958] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:51:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:01.665165 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5d915-22e9-459b-b0da-04f401a6e5dd None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:01.665761 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5d915-22e9-459b-b0da-04f401a6e5dd None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:01.665761 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5d915-22e9-459b-b0da-04f401a6e5dd None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:01.667117 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 480/959] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:01.674245 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c019d-dd31-4a07-85db-d66dd07b86fc None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:01.674645 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c019d-dd31-4a07-85db-d66dd07b86fc None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:01.674802 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c019d-dd31-4a07-85db-d66dd07b86fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:01.695401 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-6a2c019d-dd31-4a07-85db-d66dd07b86fc None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:01.696589 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-6a2c019d-dd31-4a07-85db-d66dd07b86fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:01.704678 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 480/960] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:52:01 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:01.742094 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5d915-22e9-459b-b0da-04f401a6e5dd None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:01.753240 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5d915-22e9-459b-b0da-04f401a6e5dd None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:01.756711 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda2c79-d7c8-422f-8483-a9d4188e2a9c service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a0fd1ca90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:01.757319 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda2c79-d7c8-422f-8483-a9d4188e2a9c service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:01.757631 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda2c79-d7c8-422f-8483-a9d4188e2a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:01.757914 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda2c79-d7c8-422f-8483-a9d4188e2a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:01.767533 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda2c79-d7c8-422f-8483-a9d4188e2a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:01.768974 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda2c79-d7c8-422f-8483-a9d4188e2a9c service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:01.778211 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 481/961] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:01 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:06.092971 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e45e5-dfbe-404f-baf9-e1e05eb229c8 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:06.093499 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e45e5-dfbe-404f-baf9-e1e05eb229c8 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:06.093499 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e45e5-dfbe-404f-baf9-e1e05eb229c8 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:06.094975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 481/962] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:06.099904 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d811f53-568c-4063-abdb-4762ed6f1146 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:06.100311 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d811f53-568c-4063-abdb-4762ed6f1146 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:06.100465 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d811f53-568c-4063-abdb-4762ed6f1146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:06.119330 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-5d811f53-568c-4063-abdb-4762ed6f1146 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:06.120500 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-5d811f53-568c-4063-abdb-4762ed6f1146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:06.128611 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 482/963] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:52:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:06.169552 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e45e5-dfbe-404f-baf9-e1e05eb229c8 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:06.179952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e45e5-dfbe-404f-baf9-e1e05eb229c8 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:06.183369 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34db927-77ac-4ebc-a5a7-c0b9ef3810d6 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a0fc49cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:06.184064 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34db927-77ac-4ebc-a5a7-c0b9ef3810d6 service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:06.184570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34db927-77ac-4ebc-a5a7-c0b9ef3810d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:06.184868 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34db927-77ac-4ebc-a5a7-c0b9ef3810d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:06.193455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34db927-77ac-4ebc-a5a7-c0b9ef3810d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:06.194908 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34db927-77ac-4ebc-a5a7-c0b9ef3810d6 service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:06.205102 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 482/964] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:09.078584 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f6eab-b44e-480b-8f2c-be2f95ce1dba None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:09.079165 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f6eab-b44e-480b-8f2c-be2f95ce1dba None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:09.079165 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f6eab-b44e-480b-8f2c-be2f95ce1dba None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:09.080455 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 483/965] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:09.085644 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c456b-39dd-4367-8f5f-649989691103 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:09.086044 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c456b-39dd-4367-8f5f-649989691103 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:09.086199 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c456b-39dd-4367-8f5f-649989691103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:09.106262 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-101c456b-39dd-4367-8f5f-649989691103 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:09.107443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-101c456b-39dd-4367-8f5f-649989691103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:09.115212 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 483/966] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:52:09 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:09.154441 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f6eab-b44e-480b-8f2c-be2f95ce1dba None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:09.165112 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f6eab-b44e-480b-8f2c-be2f95ce1dba None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:09.168830 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd91e7a-db65-46a9-b678-41452654647e service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fc75fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:09.169524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd91e7a-db65-46a9-b678-41452654647e service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:09.169903 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd91e7a-db65-46a9-b678-41452654647e service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:09.170251 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd91e7a-db65-46a9-b678-41452654647e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:09.179346 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd91e7a-db65-46a9-b678-41452654647e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:09.180801 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd91e7a-db65-46a9-b678-41452654647e service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:09.190503 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 484/967] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:09 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:13.658857 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa726949-bbd7-4e23-a677-344c895c4fc8 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:13.659386 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa726949-bbd7-4e23-a677-344c895c4fc8 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:13.659479 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa726949-bbd7-4e23-a677-344c895c4fc8 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:13.660786 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 484/968] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:13.666008 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4eb6d-3229-4859-a906-afd7ded1b487 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:13.666427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4eb6d-3229-4859-a906-afd7ded1b487 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:13.666573 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4eb6d-3229-4859-a906-afd7ded1b487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:13.674805 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=57 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:52:13.687935 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-bcb4eb6d-3229-4859-a906-afd7ded1b487 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:13.689274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-bcb4eb6d-3229-4859-a906-afd7ded1b487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:13.697220 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 485/969] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:52:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:13.736542 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa726949-bbd7-4e23-a677-344c895c4fc8 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:13.748561 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa726949-bbd7-4e23-a677-344c895c4fc8 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:13.751020 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32f606-1573-4786-a954-52062070cea5 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a0fe87a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:13.751637 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32f606-1573-4786-a954-52062070cea5 service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:13.751916 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32f606-1573-4786-a954-52062070cea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:13.752186 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32f606-1573-4786-a954-52062070cea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:13.762475 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32f606-1573-4786-a954-52062070cea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:13.764078 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32f606-1573-4786-a954-52062070cea5 service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:13.773683 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 485/970] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:19.339335 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2291f55-07a3-4c53-a903-655667b8465c None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:19.340323 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2291f55-07a3-4c53-a903-655667b8465c None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:19.340811 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2291f55-07a3-4c53-a903-655667b8465c None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:19.342873 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 486/971] 10.222.0.47 () {54 vars in 921 bytes} [Mon Jul 25 22:52:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:19.355887 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929c41e-5ffd-444b-a7c1-f79530e00996 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:19.356382 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929c41e-5ffd-444b-a7c1-f79530e00996 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:19.356460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929c41e-5ffd-444b-a7c1-f79530e00996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:19.442993 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-3929c41e-5ffd-444b-a7c1-f79530e00996 None None] MFA Rules not processed for user `530c96407340435c982fd99367689007`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:19.444426 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-3929c41e-5ffd-444b-a7c1-f79530e00996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:19.530472 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 486/972] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Jul 25 22:52:19 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:23.682570 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=2 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:52:23.966555 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c8ad3-701a-40fd-80b7-42a95acdaf03 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:23.966949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c8ad3-701a-40fd-80b7-42a95acdaf03 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:23.967158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c8ad3-701a-40fd-80b7-42a95acdaf03 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:23.968649 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 487/973] 10.222.0.47 () {54 vars in 921 bytes} [Mon Jul 25 22:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:23.973464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28ef58-6058-48d7-b5dd-ce9c72c32727 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:23.973946 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28ef58-6058-48d7-b5dd-ce9c72c32727 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:23.974063 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28ef58-6058-48d7-b5dd-ce9c72c32727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:23.993821 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-cc28ef58-6058-48d7-b5dd-ce9c72c32727 None None] MFA Rules not processed for user `530c96407340435c982fd99367689007`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:23.995541 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-cc28ef58-6058-48d7-b5dd-ce9c72c32727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:24.004109 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 487/974] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Jul 25 22:52:23 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:25.561235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038072b2-a497-4695-bfb5-fa3d2c7567c9 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:25.561798 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038072b2-a497-4695-bfb5-fa3d2c7567c9 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:25.561798 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038072b2-a497-4695-bfb5-fa3d2c7567c9 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:25.563141 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 488/975] 10.222.0.47 () {54 vars in 921 bytes} [Mon Jul 25 22:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:25.568065 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a87a10-3103-4dc2-aa34-07b054c318a4 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:25.568486 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a87a10-3103-4dc2-aa34-07b054c318a4 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:25.568651 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a87a10-3103-4dc2-aa34-07b054c318a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:25.590704 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-24a87a10-3103-4dc2-aa34-07b054c318a4 None None] MFA Rules not processed for user `530c96407340435c982fd99367689007`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:25.591872 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-24a87a10-3103-4dc2-aa34-07b054c318a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:25.600133 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 488/976] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Jul 25 22:52:25 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:29.608048 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574835f8-2ac7-4ae0-82c4-fab6e1eb22ba None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:29.609120 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574835f8-2ac7-4ae0-82c4-fab6e1eb22ba None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:29.609652 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574835f8-2ac7-4ae0-82c4-fab6e1eb22ba None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:29.614202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 489/977] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:52:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:29.616551 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89d6e0-d17e-4d53-aa4d-6b67d8e68560 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:29.617356 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89d6e0-d17e-4d53-aa4d-6b67d8e68560 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:29.617886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89d6e0-d17e-4d53-aa4d-6b67d8e68560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:29.626186 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=69 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:52:29.646027 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-5d89d6e0-d17e-4d53-aa4d-6b67d8e68560 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:29.647715 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-5d89d6e0-d17e-4d53-aa4d-6b67d8e68560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:29.670017 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 489/978] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:52:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:29.715992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d958c6-425c-40a2-9051-b3220cc9e216 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:29.716553 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d958c6-425c-40a2-9051-b3220cc9e216 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:29.717041 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d958c6-425c-40a2-9051-b3220cc9e216 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:29.718863 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 490/979] 10.222.0.47 () {54 vars in 962 bytes} [Mon Jul 25 22:52:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:29.741620 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8520ed-6b9e-4295-a430-2622e50bb5d3 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:29.742179 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8520ed-6b9e-4295-a430-2622e50bb5d3 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:29.742494 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8520ed-6b9e-4295-a430-2622e50bb5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:29.795318 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-fe8520ed-6b9e-4295-a430-2622e50bb5d3 None None] MFA Rules not processed for user `a2528d7506a5481f8fa6bb5012b4a9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:29.796575 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-fe8520ed-6b9e-4295-a430-2622e50bb5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:29.879064 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 490/980] 10.222.0.47 () {58 vars in 1059 bytes} [Mon Jul 25 22:52:29 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:29.888547 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d958c6-425c-40a2-9051-b3220cc9e216 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:29.903062 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d958c6-425c-40a2-9051-b3220cc9e216 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:29.908422 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33f06a-074a-49a7-ab9b-48137959f196 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=squExIY4SuKTFvoPKMtObA, audit_chain_id=['squExIY4SuKTFvoPKMtObA']) at 0x7f8a0fbc1460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:29.909317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33f06a-074a-49a7-ab9b-48137959f196 service nova] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:29.909788 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33f06a-074a-49a7-ab9b-48137959f196 service nova] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:29.910225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33f06a-074a-49a7-ab9b-48137959f196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:29.919034 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33f06a-074a-49a7-ab9b-48137959f196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:29.920811 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33f06a-074a-49a7-ab9b-48137959f196 service nova] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:29.933900 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 491/981] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:32.423509 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe0d72-cf15-41c0-ab4e-ff9625d7cbcf None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:32.424082 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe0d72-cf15-41c0-ab4e-ff9625d7cbcf None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:32.424082 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe0d72-cf15-41c0-ab4e-ff9625d7cbcf None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:32.425637 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 491/982] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:32.430607 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe258f-422b-4979-91bb-0ac04aa5c60a None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:32.431011 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe258f-422b-4979-91bb-0ac04aa5c60a None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:32.431175 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe258f-422b-4979-91bb-0ac04aa5c60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:32.451580 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-ffbe258f-422b-4979-91bb-0ac04aa5c60a None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:32.452790 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-ffbe258f-422b-4979-91bb-0ac04aa5c60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:32.464090 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 492/983] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:52:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:32.511648 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe0d72-cf15-41c0-ab4e-ff9625d7cbcf None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:32.529778 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe0d72-cf15-41c0-ab4e-ff9625d7cbcf None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:32.534993 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a46b0f-a15b-411f-b946-302f8668cdf5 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=squExIY4SuKTFvoPKMtObA, audit_chain_id=['squExIY4SuKTFvoPKMtObA']) at 0x7f8a0fdd50a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:32.535610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a46b0f-a15b-411f-b946-302f8668cdf5 service nova] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:32.535896 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a46b0f-a15b-411f-b946-302f8668cdf5 service nova] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:32.536176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a46b0f-a15b-411f-b946-302f8668cdf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:32.545440 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a46b0f-a15b-411f-b946-302f8668cdf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:32.547106 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a46b0f-a15b-411f-b946-302f8668cdf5 service nova] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:32.557295 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 492/984] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:52:35.165128 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82dd2a-8e6d-4456-a962-01660d48a456 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:35.165738 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82dd2a-8e6d-4456-a962-01660d48a456 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:35.165738 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82dd2a-8e6d-4456-a962-01660d48a456 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:35.167915 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 493/985] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:52:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:35.173174 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60446ddc-ef50-421e-bc7c-2e839580c364 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:35.173647 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60446ddc-ef50-421e-bc7c-2e839580c364 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:35.173849 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60446ddc-ef50-421e-bc7c-2e839580c364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:35.193532 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-60446ddc-ef50-421e-bc7c-2e839580c364 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:35.194811 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-60446ddc-ef50-421e-bc7c-2e839580c364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:35.218438 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 493/986] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:52:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:35.253266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd971ef-bb05-41dd-9595-c75d14cc0b92 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:35.253558 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd971ef-bb05-41dd-9595-c75d14cc0b92 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:35.253867 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd971ef-bb05-41dd-9595-c75d14cc0b92 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:35.255447 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 494/987] 10.222.0.47 () {54 vars in 962 bytes} [Mon Jul 25 22:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:35.267294 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dbce0-2977-4d6a-9cee-c9a27a883a5a None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:35.267586 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dbce0-2977-4d6a-9cee-c9a27a883a5a None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:35.267865 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dbce0-2977-4d6a-9cee-c9a27a883a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:35.290406 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-2b8dbce0-2977-4d6a-9cee-c9a27a883a5a None None] MFA Rules not processed for user `a2528d7506a5481f8fa6bb5012b4a9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:35.291977 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-2b8dbce0-2977-4d6a-9cee-c9a27a883a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:35.301865 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 494/988] 10.222.0.47 () {58 vars in 1059 bytes} [Mon Jul 25 22:52:35 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:35.314011 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd971ef-bb05-41dd-9595-c75d14cc0b92 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:35.329926 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd971ef-bb05-41dd-9595-c75d14cc0b92 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:35.335351 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b394f-f9a7-45f7-a32d-8ba30ca501dd service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=EuIKcMJpS6uru_OiCoau7Q, audit_chain_id=['EuIKcMJpS6uru_OiCoau7Q']) at 0x7f8a0fbc4a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:35.335918 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b394f-f9a7-45f7-a32d-8ba30ca501dd service nova] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:35.336199 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b394f-f9a7-45f7-a32d-8ba30ca501dd service nova] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:35.336474 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b394f-f9a7-45f7-a32d-8ba30ca501dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:35.346159 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b394f-f9a7-45f7-a32d-8ba30ca501dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:35.347774 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b394f-f9a7-45f7-a32d-8ba30ca501dd service nova] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:35.357513 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 495/989] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:37.700976 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ff7c7-242e-415a-a090-9781b4551d4a None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:37.701987 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ff7c7-242e-415a-a090-9781b4551d4a None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:37.702564 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ff7c7-242e-415a-a090-9781b4551d4a None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:37.707967 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 495/990] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:37.710759 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fb9f2-69ce-4eeb-8524-67ad7e5a3774 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:37.711605 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fb9f2-69ce-4eeb-8524-67ad7e5a3774 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:37.712116 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fb9f2-69ce-4eeb-8524-67ad7e5a3774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:37.733921 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-418fb9f2-69ce-4eeb-8524-67ad7e5a3774 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:37.735471 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-418fb9f2-69ce-4eeb-8524-67ad7e5a3774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:37.749903 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 496/991] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:52:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:37.794071 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ff7c7-242e-415a-a090-9781b4551d4a None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:37.808813 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ff7c7-242e-415a-a090-9781b4551d4a None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:37.814573 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80827b3c-5e34-4b37-9ce0-d7fea71fdc9c service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=squExIY4SuKTFvoPKMtObA, audit_chain_id=['squExIY4SuKTFvoPKMtObA']) at 0x7f8a0f9c6cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:37.815464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80827b3c-5e34-4b37-9ce0-d7fea71fdc9c service nova] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:37.815954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80827b3c-5e34-4b37-9ce0-d7fea71fdc9c service nova] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:37.816435 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80827b3c-5e34-4b37-9ce0-d7fea71fdc9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:37.826510 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80827b3c-5e34-4b37-9ce0-d7fea71fdc9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:37.828397 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80827b3c-5e34-4b37-9ce0-d7fea71fdc9c service nova] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:37.854520 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 496/992] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:39.791656 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec527cd-2269-40a2-8264-23b4840920f0 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:39.792080 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec527cd-2269-40a2-8264-23b4840920f0 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:39.792310 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec527cd-2269-40a2-8264-23b4840920f0 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:39.797388 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 497/993] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:52:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:39.798920 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1463-ff12-4ca5-ac02-e772f3a3b161 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:39.799310 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1463-ff12-4ca5-ac02-e772f3a3b161 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:39.799488 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1463-ff12-4ca5-ac02-e772f3a3b161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:39.828832 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-c42e1463-ff12-4ca5-ac02-e772f3a3b161 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:39.830821 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-c42e1463-ff12-4ca5-ac02-e772f3a3b161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:39.841615 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 497/994] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:52:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:40.156414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9481a7-4184-4956-ad2e-63e15b167030 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:40.156414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9481a7-4184-4956-ad2e-63e15b167030 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:40.156414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9481a7-4184-4956-ad2e-63e15b167030 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:40.158941 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 498/995] 10.222.0.47 () {54 vars in 964 bytes} [Mon Jul 25 22:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:40.162435 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8a9a0-d6bd-4622-ab52-2002e664724d None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:40.162729 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8a9a0-d6bd-4622-ab52-2002e664724d None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:40.163014 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8a9a0-d6bd-4622-ab52-2002e664724d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:40.201727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-0dc8a9a0-d6bd-4622-ab52-2002e664724d None None] MFA Rules not processed for user `cc1a058881084fbdbf53096109e5381f`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:40.203161 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-0dc8a9a0-d6bd-4622-ab52-2002e664724d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:40.239588 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170f20f-f8f3-4161-bd50-105ce16b4e65 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:40.240346 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170f20f-f8f3-4161-bd50-105ce16b4e65 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:40.240880 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170f20f-f8f3-4161-bd50-105ce16b4e65 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:40.242820 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 499/996] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:52:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:52:40.247598 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045382a-a31c-4b1c-8140-f9acd2a64c0f None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:40.248156 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045382a-a31c-4b1c-8140-f9acd2a64c0f None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:40.248650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045382a-a31c-4b1c-8140-f9acd2a64c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:40.266482 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 498/997] 10.222.0.47 () {58 vars in 1061 bytes} [Mon Jul 25 22:52:40 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:40.271039 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-0045382a-a31c-4b1c-8140-f9acd2a64c0f None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:40.272442 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-0045382a-a31c-4b1c-8140-f9acd2a64c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:40.274028 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8a9a0-d6bd-4622-ab52-2002e664724d None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:40.282975 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 500/998] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:52:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:40.286629 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8a9a0-d6bd-4622-ab52-2002e664724d None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:40.290542 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2fdf0f-2899-4707-ab57-4b81286c2df4 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=sIAHV-EsQJKrufg4i7I-sw, audit_chain_id=['sIAHV-EsQJKrufg4i7I-sw']) at 0x7f8a0fa2e520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc1a058881084fbdbf53096109e5381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:40.292078 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fdf0f-2899-4707-ab57-4b81286c2df4 service cinder] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:40.292608 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fdf0f-2899-4707-ab57-4b81286c2df4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:40.292608 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2fdf0f-2899-4707-ab57-4b81286c2df4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:40.303466 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fdf0f-2899-4707-ab57-4b81286c2df4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:40.304933 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2fdf0f-2899-4707-ab57-4b81286c2df4 service cinder] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:40.309940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:52:40.319824 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 499/999] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:52:40.330085 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045382a-a31c-4b1c-8140-f9acd2a64c0f None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:40.342553 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045382a-a31c-4b1c-8140-f9acd2a64c0f None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:40.347693 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb71012-fc1b-48b5-b3dc-e9214fcc7cb6 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=EuIKcMJpS6uru_OiCoau7Q, audit_chain_id=['EuIKcMJpS6uru_OiCoau7Q']) at 0x7f8a0fe204c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:40.348390 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb71012-fc1b-48b5-b3dc-e9214fcc7cb6 service nova] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:40.348754 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb71012-fc1b-48b5-b3dc-e9214fcc7cb6 service nova] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:40.349109 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb71012-fc1b-48b5-b3dc-e9214fcc7cb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:40.358197 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb71012-fc1b-48b5-b3dc-e9214fcc7cb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:40.359881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb71012-fc1b-48b5-b3dc-e9214fcc7cb6 service nova] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:40.370029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 501/1000] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:42.698580 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28623e-bb7b-4128-8924-1cc76a2a42aa None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:42.699010 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28623e-bb7b-4128-8924-1cc76a2a42aa None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:42.699137 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28623e-bb7b-4128-8924-1cc76a2a42aa None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:42.700478 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 500/1001] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:42.705789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9e9cd-0ac6-4d13-83fe-0e696ba76721 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:42.706218 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9e9cd-0ac6-4d13-83fe-0e696ba76721 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:42.706364 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9e9cd-0ac6-4d13-83fe-0e696ba76721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:42.726528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-2ee9e9cd-0ac6-4d13-83fe-0e696ba76721 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:42.727749 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-2ee9e9cd-0ac6-4d13-83fe-0e696ba76721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:42.736529 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 502/1002] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:52:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:42.783638 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28623e-bb7b-4128-8924-1cc76a2a42aa None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:42.797791 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28623e-bb7b-4128-8924-1cc76a2a42aa None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:42.802827 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40882c-1f72-41c3-83c2-ec4a8b0a45bc service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=squExIY4SuKTFvoPKMtObA, audit_chain_id=['squExIY4SuKTFvoPKMtObA']) at 0x7f8a0fa2e880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:42.803607 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40882c-1f72-41c3-83c2-ec4a8b0a45bc service nova] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:42.803894 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40882c-1f72-41c3-83c2-ec4a8b0a45bc service nova] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:42.804175 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40882c-1f72-41c3-83c2-ec4a8b0a45bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:42.812981 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40882c-1f72-41c3-83c2-ec4a8b0a45bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:42.814632 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40882c-1f72-41c3-83c2-ec4a8b0a45bc service nova] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:42.825110 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 501/1003] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:45.102461 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2690a-5a13-4f4f-b2f7-539339cbbd06 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:45.103542 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2690a-5a13-4f4f-b2f7-539339cbbd06 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:45.103864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2690a-5a13-4f4f-b2f7-539339cbbd06 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:45.105317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 503/1004] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:52:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:45.110720 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b7f3f-972f-4f49-a17b-3e1563495a70 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:45.111154 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b7f3f-972f-4f49-a17b-3e1563495a70 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:45.111287 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b7f3f-972f-4f49-a17b-3e1563495a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:45.133175 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-a53b7f3f-972f-4f49-a17b-3e1563495a70 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:45.134749 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-a53b7f3f-972f-4f49-a17b-3e1563495a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:45.143356 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 502/1005] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:52:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:45.186983 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2690a-5a13-4f4f-b2f7-539339cbbd06 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:45.200699 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2690a-5a13-4f4f-b2f7-539339cbbd06 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:45.205832 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539bddb-0808-4172-a4c6-acfe2d2e9916 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=EuIKcMJpS6uru_OiCoau7Q, audit_chain_id=['EuIKcMJpS6uru_OiCoau7Q']) at 0x7f8a0fc4eac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:45.206453 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539bddb-0808-4172-a4c6-acfe2d2e9916 service nova] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:45.207429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539bddb-0808-4172-a4c6-acfe2d2e9916 service nova] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:45.207723 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539bddb-0808-4172-a4c6-acfe2d2e9916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:45.216485 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539bddb-0808-4172-a4c6-acfe2d2e9916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:45.218122 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539bddb-0808-4172-a4c6-acfe2d2e9916 service nova] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:45.228416 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 504/1006] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:47.480235 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e64540-cfe2-4962-a245-b67214f732df None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:47.480748 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e64540-cfe2-4962-a245-b67214f732df None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:47.480846 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e64540-cfe2-4962-a245-b67214f732df None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:47.484660 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 503/1007] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:52:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:47.490317 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de3d85-ac90-4a87-aac9-adf791886a4d None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:47.490822 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de3d85-ac90-4a87-aac9-adf791886a4d None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:47.490940 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de3d85-ac90-4a87-aac9-adf791886a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:47.513376 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-b9de3d85-ac90-4a87-aac9-adf791886a4d None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:47.514626 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-b9de3d85-ac90-4a87-aac9-adf791886a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:47.526134 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 505/1008] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:52:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:47.568412 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e64540-cfe2-4962-a245-b67214f732df None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:47.582698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e64540-cfe2-4962-a245-b67214f732df None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:47.588254 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630e45c-c628-4c30-b896-c464761736d2 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=EuIKcMJpS6uru_OiCoau7Q, audit_chain_id=['EuIKcMJpS6uru_OiCoau7Q']) at 0x7f8a0fc49850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:47.588859 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630e45c-c628-4c30-b896-c464761736d2 service nova] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:47.589137 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630e45c-c628-4c30-b896-c464761736d2 service nova] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:47.589405 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630e45c-c628-4c30-b896-c464761736d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:47.599259 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630e45c-c628-4c30-b896-c464761736d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:47.600838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630e45c-c628-4c30-b896-c464761736d2 service nova] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:47.611952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 504/1009] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:50.340932 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b8636-c9ed-4edd-b180-c883b354fd86 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:50.344326 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b8636-c9ed-4edd-b180-c883b354fd86 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:50.344326 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b8636-c9ed-4edd-b180-c883b354fd86 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:50.344326 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 506/1010] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:52:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:50.350022 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419d3e6-3766-48b3-be1e-15e72e6d0956 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:50.350523 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419d3e6-3766-48b3-be1e-15e72e6d0956 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:50.350699 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419d3e6-3766-48b3-be1e-15e72e6d0956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:50.378022 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-e419d3e6-3766-48b3-be1e-15e72e6d0956 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:50.379454 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-e419d3e6-3766-48b3-be1e-15e72e6d0956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:50.389121 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 505/1011] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:52:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:50.447111 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b8636-c9ed-4edd-b180-c883b354fd86 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:50.476734 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b8636-c9ed-4edd-b180-c883b354fd86 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:50.485935 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa7048-8d03-4c44-b72e-8facb5103c2a service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=squExIY4SuKTFvoPKMtObA, audit_chain_id=['squExIY4SuKTFvoPKMtObA']) at 0x7f8a0fc4e580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:50.486856 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa7048-8d03-4c44-b72e-8facb5103c2a service nova] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:50.490103 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa7048-8d03-4c44-b72e-8facb5103c2a service nova] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:50.490595 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa7048-8d03-4c44-b72e-8facb5103c2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:50.502005 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa7048-8d03-4c44-b72e-8facb5103c2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:50.504205 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa7048-8d03-4c44-b72e-8facb5103c2a service nova] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:50.527553 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 507/1012] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:53.085788 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebf724-4b5b-4901-bdfe-6a67155e5f08 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:53.086589 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebf724-4b5b-4901-bdfe-6a67155e5f08 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:53.086589 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebf724-4b5b-4901-bdfe-6a67155e5f08 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:53.094636 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 506/1013] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:52:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:53.096843 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa26ff-53c0-4c7b-b2b4-a1a5bae37bd4 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:53.097384 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa26ff-53c0-4c7b-b2b4-a1a5bae37bd4 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:53.097477 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa26ff-53c0-4c7b-b2b4-a1a5bae37bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:53.120959 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-7aaa26ff-53c0-4c7b-b2b4-a1a5bae37bd4 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:53.122202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-7aaa26ff-53c0-4c7b-b2b4-a1a5bae37bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:53.130256 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 508/1014] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:52:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:53.194189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebf724-4b5b-4901-bdfe-6a67155e5f08 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:53.209653 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebf724-4b5b-4901-bdfe-6a67155e5f08 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:53.216514 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ded98f-1bb1-4fb3-b0af-5a7f65e44b23 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=EuIKcMJpS6uru_OiCoau7Q, audit_chain_id=['EuIKcMJpS6uru_OiCoau7Q']) at 0x7f8a0fa1a6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:53.217337 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ded98f-1bb1-4fb3-b0af-5a7f65e44b23 service nova] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:53.217727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ded98f-1bb1-4fb3-b0af-5a7f65e44b23 service nova] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:53.218097 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ded98f-1bb1-4fb3-b0af-5a7f65e44b23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:53.229333 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ded98f-1bb1-4fb3-b0af-5a7f65e44b23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:53.231971 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ded98f-1bb1-4fb3-b0af-5a7f65e44b23 service nova] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:53.243121 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 507/1015] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:52:56.113264 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc6d08-6cdd-4a9b-8485-ccf93f6d5f7b None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:56.113983 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc6d08-6cdd-4a9b-8485-ccf93f6d5f7b None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:56.113983 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc6d08-6cdd-4a9b-8485-ccf93f6d5f7b None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:56.115224 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 509/1016] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:56.121008 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be7062-b8eb-4561-b983-ba6c09018a99 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:56.121465 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be7062-b8eb-4561-b983-ba6c09018a99 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:56.121568 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be7062-b8eb-4561-b983-ba6c09018a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:56.143165 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-26be7062-b8eb-4561-b983-ba6c09018a99 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:56.144356 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-26be7062-b8eb-4561-b983-ba6c09018a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:56.152420 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 508/1017] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:52:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:56.196655 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc6d08-6cdd-4a9b-8485-ccf93f6d5f7b None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:56.205058 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=49 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:52:56.205494 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddd589-9ffc-44bc-a0e3-a789dfc84773 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:56.205942 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddd589-9ffc-44bc-a0e3-a789dfc84773 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:56.206107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddd589-9ffc-44bc-a0e3-a789dfc84773 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:56.207458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 509/1018] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:52:56.212458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd73d3-b86a-4b48-8dc7-01357f2ab5d6 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:56.213263 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd73d3-b86a-4b48-8dc7-01357f2ab5d6 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:56.213539 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc6d08-6cdd-4a9b-8485-ccf93f6d5f7b None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:56.213698 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd73d3-b86a-4b48-8dc7-01357f2ab5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:56.218768 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdc8c7-01b7-4e41-a8cd-a654627b8e62 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=squExIY4SuKTFvoPKMtObA, audit_chain_id=['squExIY4SuKTFvoPKMtObA']) at 0x7f8a0fe204c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:56.219385 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdc8c7-01b7-4e41-a8cd-a654627b8e62 service nova] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:56.219673 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdc8c7-01b7-4e41-a8cd-a654627b8e62 service nova] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:56.220076 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdc8c7-01b7-4e41-a8cd-a654627b8e62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:56.229509 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdc8c7-01b7-4e41-a8cd-a654627b8e62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:56.231255 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdc8c7-01b7-4e41-a8cd-a654627b8e62 service nova] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:56.232948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-c7bd73d3-b86a-4b48-8dc7-01357f2ab5d6 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:56.234178 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-c7bd73d3-b86a-4b48-8dc7-01357f2ab5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:56.240655 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 510/1019] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:56.242718 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 510/1020] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:52:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:52:56.301673 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303c655-d044-456e-91b5-da374408dae2 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:56.302153 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303c655-d044-456e-91b5-da374408dae2 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:56.302319 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303c655-d044-456e-91b5-da374408dae2 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:56.306773 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 511/1021] 10.222.0.47 () {54 vars in 966 bytes} [Mon Jul 25 22:52:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:56.312212 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529964a-1339-45b1-ab7d-43529f4a0bbf None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:56.312512 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529964a-1339-45b1-ab7d-43529f4a0bbf None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:56.312798 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529964a-1339-45b1-ab7d-43529f4a0bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:56.356612 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-c529964a-1339-45b1-ab7d-43529f4a0bbf None None] MFA Rules not processed for user `bea7c9ce1d3c4fe983e5944e5f92ff91`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:56.358200 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-c529964a-1339-45b1-ab7d-43529f4a0bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:56.424609 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 511/1022] 10.222.0.47 () {58 vars in 1063 bytes} [Mon Jul 25 22:52:56 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:56.432250 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303c655-d044-456e-91b5-da374408dae2 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:56.443249 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303c655-d044-456e-91b5-da374408dae2 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:56.446859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a0194-1e0d-48b6-ab4d-72515dbc2492 service glance] RBAC: auth_context: {'token': <TokenModel (audit_id=EU2NQN1wTmmvvXmGu-AJxA, audit_chain_id=['EU2NQN1wTmmvvXmGu-AJxA']) at 0x7f8a0fc4e460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bea7c9ce1d3c4fe983e5944e5f92ff91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:56.448062 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a0194-1e0d-48b6-ab4d-72515dbc2492 service glance] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:56.448347 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a0194-1e0d-48b6-ab4d-72515dbc2492 service glance] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:56.448627 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a0194-1e0d-48b6-ab4d-72515dbc2492 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:56.458685 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a0194-1e0d-48b6-ab4d-72515dbc2492 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:56.460154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a0194-1e0d-48b6-ab4d-72515dbc2492 service glance] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:56.471240 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 512/1023] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:58.532724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1e0b9-848c-49ec-9ce1-df11ad7c946b None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:58.532724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1e0b9-848c-49ec-9ce1-df11ad7c946b None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:58.532724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1e0b9-848c-49ec-9ce1-df11ad7c946b None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:58.533549 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 512/1024] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:58.539443 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0180e28-d956-4fbe-9170-0b9f290c734d None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:58.539944 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0180e28-d956-4fbe-9170-0b9f290c734d None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:58.540071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0180e28-d956-4fbe-9170-0b9f290c734d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:58.561479 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-b0180e28-d956-4fbe-9170-0b9f290c734d None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:58.562730 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-b0180e28-d956-4fbe-9170-0b9f290c734d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:58.570756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 513/1025] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:52:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:52:58.619884 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1e0b9-848c-49ec-9ce1-df11ad7c946b None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:58.636474 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1e0b9-848c-49ec-9ce1-df11ad7c946b None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:58.642934 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a3782-0eda-40db-955a-50fed6e6f969 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=EuIKcMJpS6uru_OiCoau7Q, audit_chain_id=['EuIKcMJpS6uru_OiCoau7Q']) at 0x7f8a0fc9f400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:58.643550 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a3782-0eda-40db-955a-50fed6e6f969 service nova] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:58.643831 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a3782-0eda-40db-955a-50fed6e6f969 service nova] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:58.644106 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a3782-0eda-40db-955a-50fed6e6f969 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:58.653954 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a3782-0eda-40db-955a-50fed6e6f969 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:58.655531 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a3782-0eda-40db-955a-50fed6e6f969 service nova] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:58.667152 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 513/1026] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:53:08.556947 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=14 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:08.661876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=70 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:11.688813 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f36a6d-2262-4a40-b3bc-9f7f643c3632 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:11.689464 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f36a6d-2262-4a40-b3bc-9f7f643c3632 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:11.689464 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f36a6d-2262-4a40-b3bc-9f7f643c3632 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:11.690854 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 514/1027] 10.222.0.47 () {54 vars in 918 bytes} [Mon Jul 25 22:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:11.696901 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b7de9-cc94-4da4-9a36-773a4f1238f3 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:11.697557 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b7de9-cc94-4da4-9a36-773a4f1238f3 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:11.697557 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b7de9-cc94-4da4-9a36-773a4f1238f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:11.717329 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-4d4b7de9-cc94-4da4-9a36-773a4f1238f3 None None] MFA Rules not processed for user `530c96407340435c982fd99367689007`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:11.723707 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-4d4b7de9-cc94-4da4-9a36-773a4f1238f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:11.732940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 514/1028] 10.222.0.47 () {58 vars in 1015 bytes} [Mon Jul 25 22:53:11 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:11.746832 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3302c9-0bff-4929-a4b3-1a306dcb773c None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:11.747144 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3302c9-0bff-4929-a4b3-1a306dcb773c None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:11.747420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3302c9-0bff-4929-a4b3-1a306dcb773c None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:11.748720 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 515/1029] 10.222.0.47 () {54 vars in 918 bytes} [Mon Jul 25 22:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:11.753341 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddd060-2fab-4e6a-bcce-9a10a8a143fb None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:11.753663 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddd060-2fab-4e6a-bcce-9a10a8a143fb None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:11.754015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddd060-2fab-4e6a-bcce-9a10a8a143fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:11.773279 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-95ddd060-2fab-4e6a-bcce-9a10a8a143fb None None] MFA Rules not processed for user `a2528d7506a5481f8fa6bb5012b4a9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:11.774977 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-95ddd060-2fab-4e6a-bcce-9a10a8a143fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:11.783411 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 515/1030] 10.222.0.47 () {58 vars in 1015 bytes} [Mon Jul 25 22:53:11 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:14.497435 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5247dd-0c08-4193-800d-e513e6729e0b None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:14.497963 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5247dd-0c08-4193-800d-e513e6729e0b None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:14.498073 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5247dd-0c08-4193-800d-e513e6729e0b None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:14.499391 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 516/1031] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:14.504460 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dba1b-3009-4185-a5aa-ddd3317ddc9e None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:14.504879 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dba1b-3009-4185-a5aa-ddd3317ddc9e None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:14.505019 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dba1b-3009-4185-a5aa-ddd3317ddc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:14.523929 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-931dba1b-3009-4185-a5aa-ddd3317ddc9e None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:14.525277 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-931dba1b-3009-4185-a5aa-ddd3317ddc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:14.532900 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 516/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:53:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:14.576786 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5247dd-0c08-4193-800d-e513e6729e0b None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:14.591031 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5247dd-0c08-4193-800d-e513e6729e0b None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:14.596549 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90007e-f835-4767-8a54-c6a596fba20f service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=squExIY4SuKTFvoPKMtObA, audit_chain_id=['squExIY4SuKTFvoPKMtObA']) at 0x7f8a0fc0c940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:14.597188 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90007e-f835-4767-8a54-c6a596fba20f service nova] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:14.597470 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90007e-f835-4767-8a54-c6a596fba20f service nova] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:14.597776 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90007e-f835-4767-8a54-c6a596fba20f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:14.606949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90007e-f835-4767-8a54-c6a596fba20f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:14.608528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90007e-f835-4767-8a54-c6a596fba20f service nova] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:14.617928 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 517/1033] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:15.577999 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa38f2c-a7bf-4d1c-9a13-0e054e0e2428 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:15.578543 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa38f2c-a7bf-4d1c-9a13-0e054e0e2428 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:15.578543 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa38f2c-a7bf-4d1c-9a13-0e054e0e2428 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:15.579902 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 517/1034] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:15.584939 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d91ac-333e-4a72-b166-e877a318cc34 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:15.585385 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d91ac-333e-4a72-b166-e877a318cc34 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:15.585490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d91ac-333e-4a72-b166-e877a318cc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:15.606378 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-e93d91ac-333e-4a72-b166-e877a318cc34 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:15.607618 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-e93d91ac-333e-4a72-b166-e877a318cc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:15.615644 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 518/1035] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:53:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:15.835820 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa38f2c-a7bf-4d1c-9a13-0e054e0e2428 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:15.849796 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa38f2c-a7bf-4d1c-9a13-0e054e0e2428 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:15.854847 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381fb9d-f3a4-4114-92b2-7c99ccf0fdf8 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=squExIY4SuKTFvoPKMtObA, audit_chain_id=['squExIY4SuKTFvoPKMtObA']) at 0x7f8a0f9d0dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:15.855447 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381fb9d-f3a4-4114-92b2-7c99ccf0fdf8 service nova] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:15.855731 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381fb9d-f3a4-4114-92b2-7c99ccf0fdf8 service nova] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:15.856000 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381fb9d-f3a4-4114-92b2-7c99ccf0fdf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:15.864055 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381fb9d-f3a4-4114-92b2-7c99ccf0fdf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:15.865635 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381fb9d-f3a4-4114-92b2-7c99ccf0fdf8 service nova] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:15.875159 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 518/1036] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:16.780205 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd2811-64fd-4a1d-a88a-cedfea0ef62c None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:16.780729 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd2811-64fd-4a1d-a88a-cedfea0ef62c None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:16.780826 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd2811-64fd-4a1d-a88a-cedfea0ef62c None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:16.782129 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 519/1037] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:16.787018 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5e1d4-f6d6-4927-a016-7df24d3492c6 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:16.787448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5e1d4-f6d6-4927-a016-7df24d3492c6 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:16.787601 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5e1d4-f6d6-4927-a016-7df24d3492c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:16.808827 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-f1e5e1d4-f6d6-4927-a016-7df24d3492c6 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:16.810053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-f1e5e1d4-f6d6-4927-a016-7df24d3492c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:16.817715 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 519/1038] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:53:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:16.973616 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd2811-64fd-4a1d-a88a-cedfea0ef62c None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:16.987577 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd2811-64fd-4a1d-a88a-cedfea0ef62c None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:16.992427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d97e78-043c-40c0-90fa-36a838be4bf0 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=EuIKcMJpS6uru_OiCoau7Q, audit_chain_id=['EuIKcMJpS6uru_OiCoau7Q']) at 0x7f8a0fc75e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:16.993054 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d97e78-043c-40c0-90fa-36a838be4bf0 service nova] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:16.993422 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d97e78-043c-40c0-90fa-36a838be4bf0 service nova] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:16.993727 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d97e78-043c-40c0-90fa-36a838be4bf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:17.001688 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d97e78-043c-40c0-90fa-36a838be4bf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:17.003292 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d97e78-043c-40c0-90fa-36a838be4bf0 service nova] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:17.012788 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 520/1039] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:17.877244 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febfe63-e605-4dfd-bd0d-57cd5e5ec7bc None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:17.877819 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febfe63-e605-4dfd-bd0d-57cd5e5ec7bc None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:17.877819 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febfe63-e605-4dfd-bd0d-57cd5e5ec7bc None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:17.879172 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 520/1040] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:17.884864 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea2683-4871-4df6-8c86-9bc1a54606e3 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:17.885292 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea2683-4871-4df6-8c86-9bc1a54606e3 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:17.885420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea2683-4871-4df6-8c86-9bc1a54606e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:17.905158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-ecea2683-4871-4df6-8c86-9bc1a54606e3 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:17.906393 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-ecea2683-4871-4df6-8c86-9bc1a54606e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:17.914128 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 521/1041] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:53:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:18.074653 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febfe63-e605-4dfd-bd0d-57cd5e5ec7bc None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:18.088662 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febfe63-e605-4dfd-bd0d-57cd5e5ec7bc None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:18.093549 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573fa67-acec-495f-b1d8-4b538806bc7d service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=squExIY4SuKTFvoPKMtObA, audit_chain_id=['squExIY4SuKTFvoPKMtObA']) at 0x7f8a0fa05550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:18.094177 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573fa67-acec-495f-b1d8-4b538806bc7d service nova] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:18.094458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573fa67-acec-495f-b1d8-4b538806bc7d service nova] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:18.094732 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573fa67-acec-495f-b1d8-4b538806bc7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:18.102796 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573fa67-acec-495f-b1d8-4b538806bc7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:18.104355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573fa67-acec-495f-b1d8-4b538806bc7d service nova] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:18.113505 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 521/1042] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:19.053660 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b5ace-78e9-42e0-94c6-40c6d705ab57 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:19.054240 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b5ace-78e9-42e0-94c6-40c6d705ab57 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:19.054240 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b5ace-78e9-42e0-94c6-40c6d705ab57 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:19.055607 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 522/1043] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:53:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:19.061515 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e08344-bec0-4535-a5bc-835dc92ddc50 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:19.061992 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e08344-bec0-4535-a5bc-835dc92ddc50 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:19.062116 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e08344-bec0-4535-a5bc-835dc92ddc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:19.081291 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-a2e08344-bec0-4535-a5bc-835dc92ddc50 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:19.084796 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-a2e08344-bec0-4535-a5bc-835dc92ddc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:19.097282 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 522/1044] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:53:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:53:19.253785 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b5ace-78e9-42e0-94c6-40c6d705ab57 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:19.268055 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b5ace-78e9-42e0-94c6-40c6d705ab57 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:19.273099 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd75318-ae0c-4a88-80c1-0a97f92eb4f8 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=EuIKcMJpS6uru_OiCoau7Q, audit_chain_id=['EuIKcMJpS6uru_OiCoau7Q']) at 0x7f8a0fdde130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:19.273743 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd75318-ae0c-4a88-80c1-0a97f92eb4f8 service nova] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:19.274156 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd75318-ae0c-4a88-80c1-0a97f92eb4f8 service nova] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:19.274614 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd75318-ae0c-4a88-80c1-0a97f92eb4f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:19.282942 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd75318-ae0c-4a88-80c1-0a97f92eb4f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:19.284528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd75318-ae0c-4a88-80c1-0a97f92eb4f8 service nova] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:19.293901 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 523/1045] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:20.116100 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f049e-8dfe-4968-8475-11a234c3e2c6 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:20.116627 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f049e-8dfe-4968-8475-11a234c3e2c6 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:20.116627 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f049e-8dfe-4968-8475-11a234c3e2c6 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:20.118529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 523/1046] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:20.123606 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b77c9-dfd4-4364-9785-3ff413d93315 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:20.124077 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b77c9-dfd4-4364-9785-3ff413d93315 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:20.124182 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b77c9-dfd4-4364-9785-3ff413d93315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:20.143865 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-927b77c9-dfd4-4364-9785-3ff413d93315 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:20.145054 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-927b77c9-dfd4-4364-9785-3ff413d93315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:20.152800 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 524/1047] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:53:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:20.308853 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f049e-8dfe-4968-8475-11a234c3e2c6 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:20.322382 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f049e-8dfe-4968-8475-11a234c3e2c6 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:20.327279 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bce4b-f193-40f0-94a1-1f9d0e9f163a service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=EuIKcMJpS6uru_OiCoau7Q, audit_chain_id=['EuIKcMJpS6uru_OiCoau7Q']) at 0x7f8a0fdc3a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:20.327890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bce4b-f193-40f0-94a1-1f9d0e9f163a service nova] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:20.328175 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bce4b-f193-40f0-94a1-1f9d0e9f163a service nova] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:20.328455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bce4b-f193-40f0-94a1-1f9d0e9f163a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:20.336662 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bce4b-f193-40f0-94a1-1f9d0e9f163a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:20.338427 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bce4b-f193-40f0-94a1-1f9d0e9f163a service nova] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:20.347757 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 524/1048] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:21.158208 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0afc4-91ef-44d3-8d6f-c05dbc9aaf26 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:21.158736 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0afc4-91ef-44d3-8d6f-c05dbc9aaf26 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:21.158853 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0afc4-91ef-44d3-8d6f-c05dbc9aaf26 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:21.160095 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 525/1049] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:21.165322 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb8a19-4032-4e48-8178-da2494fe3bfd None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:21.165778 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb8a19-4032-4e48-8178-da2494fe3bfd None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:21.165921 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb8a19-4032-4e48-8178-da2494fe3bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:21.184995 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-c8eb8a19-4032-4e48-8178-da2494fe3bfd None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:21.186200 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-c8eb8a19-4032-4e48-8178-da2494fe3bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:21.193754 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 525/1050] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:53:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:21.353079 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0afc4-91ef-44d3-8d6f-c05dbc9aaf26 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:21.366235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0afc4-91ef-44d3-8d6f-c05dbc9aaf26 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:21.372043 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc054c-9829-476e-baad-a14e9d46bebf service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=EuIKcMJpS6uru_OiCoau7Q, audit_chain_id=['EuIKcMJpS6uru_OiCoau7Q']) at 0x7f8a0fc83040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:21.372643 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc054c-9829-476e-baad-a14e9d46bebf service nova] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:21.372925 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc054c-9829-476e-baad-a14e9d46bebf service nova] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:21.373200 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc054c-9829-476e-baad-a14e9d46bebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:21.381698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc054c-9829-476e-baad-a14e9d46bebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:21.384102 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc054c-9829-476e-baad-a14e9d46bebf service nova] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:21.393430 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 526/1051] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:22.224593 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f4526-9973-4669-87d6-b2530db77cc2 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:22.225151 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f4526-9973-4669-87d6-b2530db77cc2 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:22.225151 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f4526-9973-4669-87d6-b2530db77cc2 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:22.226431 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 526/1052] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:22.231854 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ee53c-aa18-49af-83e8-fb6745f0a8cb None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:22.232280 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ee53c-aa18-49af-83e8-fb6745f0a8cb None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:22.232418 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ee53c-aa18-49af-83e8-fb6745f0a8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:22.252118 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-ca2ee53c-aa18-49af-83e8-fb6745f0a8cb None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:22.253296 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-ca2ee53c-aa18-49af-83e8-fb6745f0a8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:22.262277 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 527/1053] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:53:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:22.422370 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f4526-9973-4669-87d6-b2530db77cc2 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:22.436186 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f4526-9973-4669-87d6-b2530db77cc2 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:22.441015 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68861f9e-cd54-4bc9-a840-431e2f0ceef1 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=EuIKcMJpS6uru_OiCoau7Q, audit_chain_id=['EuIKcMJpS6uru_OiCoau7Q']) at 0x7f8a0fcd8850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:22.441641 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68861f9e-cd54-4bc9-a840-431e2f0ceef1 service nova] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:22.441926 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68861f9e-cd54-4bc9-a840-431e2f0ceef1 service nova] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:22.442200 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68861f9e-cd54-4bc9-a840-431e2f0ceef1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:22.450680 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68861f9e-cd54-4bc9-a840-431e2f0ceef1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:22.452249 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68861f9e-cd54-4bc9-a840-431e2f0ceef1 service nova] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:22.461539 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 527/1054] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:23.272193 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8e18c-5517-4286-b6c2-d28911463d86 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:23.272763 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8e18c-5517-4286-b6c2-d28911463d86 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:23.272763 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8e18c-5517-4286-b6c2-d28911463d86 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:23.274576 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 528/1055] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:23.279351 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0edfde-f67d-42b6-b81d-e66ef2d16a3d None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:23.279796 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0edfde-f67d-42b6-b81d-e66ef2d16a3d None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:23.279895 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0edfde-f67d-42b6-b81d-e66ef2d16a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:23.299968 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-5a0edfde-f67d-42b6-b81d-e66ef2d16a3d None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:23.301148 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-5a0edfde-f67d-42b6-b81d-e66ef2d16a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:23.309965 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 528/1056] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:53:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:23.463279 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8e18c-5517-4286-b6c2-d28911463d86 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:23.476586 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8e18c-5517-4286-b6c2-d28911463d86 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:23.482409 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72600c67-f347-4e95-9693-edeaa30262ba service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=EuIKcMJpS6uru_OiCoau7Q, audit_chain_id=['EuIKcMJpS6uru_OiCoau7Q']) at 0x7f8a0fd1ceb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:23.483025 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72600c67-f347-4e95-9693-edeaa30262ba service nova] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:23.483311 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72600c67-f347-4e95-9693-edeaa30262ba service nova] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:23.483589 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72600c67-f347-4e95-9693-edeaa30262ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:23.491828 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72600c67-f347-4e95-9693-edeaa30262ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:23.494330 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72600c67-f347-4e95-9693-edeaa30262ba service nova] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:23.503580 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 529/1057] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:25.598673 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7145d3b-51f2-4960-ab70-2efdebe80955 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:25.599302 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7145d3b-51f2-4960-ab70-2efdebe80955 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:25.599302 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7145d3b-51f2-4960-ab70-2efdebe80955 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:25.600505 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 529/1058] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:25.606339 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ebc47-67d1-4435-a8e3-fc63f281324c None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:25.606769 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ebc47-67d1-4435-a8e3-fc63f281324c None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:25.606891 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ebc47-67d1-4435-a8e3-fc63f281324c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:25.626292 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-bc8ebc47-67d1-4435-a8e3-fc63f281324c None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:25.627478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-bc8ebc47-67d1-4435-a8e3-fc63f281324c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:25.635618 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 530/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:53:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:25.675941 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7145d3b-51f2-4960-ab70-2efdebe80955 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:25.687652 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7145d3b-51f2-4960-ab70-2efdebe80955 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:25.691122 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6eb67-2b96-4982-95f0-acbdb7bab498 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a0fa25040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:25.691739 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6eb67-2b96-4982-95f0-acbdb7bab498 service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:25.692018 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6eb67-2b96-4982-95f0-acbdb7bab498 service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:25.692293 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6eb67-2b96-4982-95f0-acbdb7bab498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:25.702220 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6eb67-2b96-4982-95f0-acbdb7bab498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:25.704708 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6eb67-2b96-4982-95f0-acbdb7bab498 service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:25.714200 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 530/1060] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:28.077641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a40ba-9f3c-4e7d-83fc-1a9c9e93c12e None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:28.078139 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a40ba-9f3c-4e7d-83fc-1a9c9e93c12e None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:28.078254 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a40ba-9f3c-4e7d-83fc-1a9c9e93c12e None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:28.079544 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 531/1061] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:28.084714 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278d370-323f-41d2-b74f-f4a6a444be1b None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:28.085121 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278d370-323f-41d2-b74f-f4a6a444be1b None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:28.085270 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278d370-323f-41d2-b74f-f4a6a444be1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:28.104922 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-c278d370-323f-41d2-b74f-f4a6a444be1b None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:28.106145 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-c278d370-323f-41d2-b74f-f4a6a444be1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:28.114115 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 531/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:53:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:28.155775 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a40ba-9f3c-4e7d-83fc-1a9c9e93c12e None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:28.167140 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a40ba-9f3c-4e7d-83fc-1a9c9e93c12e None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:28.170640 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d71248c-fe1c-4dcd-8c4a-7f204081dea7 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fd66370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:28.171243 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71248c-fe1c-4dcd-8c4a-7f204081dea7 service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:28.171545 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71248c-fe1c-4dcd-8c4a-7f204081dea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:28.171842 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d71248c-fe1c-4dcd-8c4a-7f204081dea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:28.181473 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71248c-fe1c-4dcd-8c4a-7f204081dea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:28.182927 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d71248c-fe1c-4dcd-8c4a-7f204081dea7 service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:28.192192 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 532/1063] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:30.790596 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160721e9-3b1a-4a89-bbdb-56a32d618920 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:30.791164 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160721e9-3b1a-4a89-bbdb-56a32d618920 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:30.791164 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160721e9-3b1a-4a89-bbdb-56a32d618920 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:30.792540 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 532/1064] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:53:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:30.797653 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc3e31-0971-4d97-ad08-c09f09d35648 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:30.798063 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc3e31-0971-4d97-ad08-c09f09d35648 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:30.798202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc3e31-0971-4d97-ad08-c09f09d35648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:30.818072 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-a8cc3e31-0971-4d97-ad08-c09f09d35648 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:30.819248 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-a8cc3e31-0971-4d97-ad08-c09f09d35648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:30.827231 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 533/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:53:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:30.866341 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160721e9-3b1a-4a89-bbdb-56a32d618920 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:30.877480 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160721e9-3b1a-4a89-bbdb-56a32d618920 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:30.881272 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c63d2c-9ccc-4cc4-b434-08cad0202784 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fe87250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:30.881904 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c63d2c-9ccc-4cc4-b434-08cad0202784 service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:30.882189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c63d2c-9ccc-4cc4-b434-08cad0202784 service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:30.882466 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c63d2c-9ccc-4cc4-b434-08cad0202784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:30.891441 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c63d2c-9ccc-4cc4-b434-08cad0202784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:30.892860 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c63d2c-9ccc-4cc4-b434-08cad0202784 service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:30.902331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 533/1066] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:33.237951 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd39b6-2323-4919-aa2c-82c98b007c19 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:33.238512 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd39b6-2323-4919-aa2c-82c98b007c19 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:33.238512 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd39b6-2323-4919-aa2c-82c98b007c19 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:33.239868 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 534/1067] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:33.245669 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7eb22-0c8a-4da0-8c5d-58cdb1e53fb8 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:33.246111 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7eb22-0c8a-4da0-8c5d-58cdb1e53fb8 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:33.246208 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7eb22-0c8a-4da0-8c5d-58cdb1e53fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:33.265638 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-c7e7eb22-0c8a-4da0-8c5d-58cdb1e53fb8 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:33.266817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-c7e7eb22-0c8a-4da0-8c5d-58cdb1e53fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:33.274671 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 534/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:53:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:33.314879 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd39b6-2323-4919-aa2c-82c98b007c19 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:33.325673 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd39b6-2323-4919-aa2c-82c98b007c19 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:33.329204 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb26a5-fde6-4a2e-b660-6faace46334e service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fdde130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:33.329878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb26a5-fde6-4a2e-b660-6faace46334e service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:33.330192 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb26a5-fde6-4a2e-b660-6faace46334e service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:33.330475 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb26a5-fde6-4a2e-b660-6faace46334e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:33.339948 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb26a5-fde6-4a2e-b660-6faace46334e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:33.341388 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb26a5-fde6-4a2e-b660-6faace46334e service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:33.350722 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 535/1069] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:35.634733 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cc757-4910-49be-accb-27dc1670f54a None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.635305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cc757-4910-49be-accb-27dc1670f54a None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.635305 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cc757-4910-49be-accb-27dc1670f54a None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.636646 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 535/1070] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:35.641988 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d84b4-2881-4ebc-96c8-f12c12ef13b4 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.642374 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d84b4-2881-4ebc-96c8-f12c12ef13b4 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.642556 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d84b4-2881-4ebc-96c8-f12c12ef13b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.661967 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-838d84b4-2881-4ebc-96c8-f12c12ef13b4 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:35.663160 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-838d84b4-2881-4ebc-96c8-f12c12ef13b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:35.671853 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 536/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:53:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:35.709839 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cc757-4910-49be-accb-27dc1670f54a None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:35.720916 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cc757-4910-49be-accb-27dc1670f54a None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:35.724381 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49e5e9-e0f1-4b2e-8d2a-93316d12dc30 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fcd8b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:35.724980 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49e5e9-e0f1-4b2e-8d2a-93316d12dc30 service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:35.725261 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49e5e9-e0f1-4b2e-8d2a-93316d12dc30 service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:35.725536 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49e5e9-e0f1-4b2e-8d2a-93316d12dc30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:35.735774 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49e5e9-e0f1-4b2e-8d2a-93316d12dc30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:35.737139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e49e5e9-e0f1-4b2e-8d2a-93316d12dc30 service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:35.746833 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 536/1072] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:38.057014 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06728ea-4cc5-4378-9c4f-9477749e4d10 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.057469 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06728ea-4cc5-4378-9c4f-9477749e4d10 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.057603 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06728ea-4cc5-4378-9c4f-9477749e4d10 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.058952 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 537/1073] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:38.064198 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468d1b8-b571-42f4-a92d-49d4163ec6ee None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.064583 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468d1b8-b571-42f4-a92d-49d4163ec6ee None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.064838 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468d1b8-b571-42f4-a92d-49d4163ec6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.084403 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-5468d1b8-b571-42f4-a92d-49d4163ec6ee None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:38.085726 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-5468d1b8-b571-42f4-a92d-49d4163ec6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:38.093631 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 537/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:53:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:38.133758 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06728ea-4cc5-4378-9c4f-9477749e4d10 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:38.144419 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06728ea-4cc5-4378-9c4f-9477749e4d10 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:38.148545 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78f9ce-1a36-4a75-9e29-bcbebecb8509 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fe138e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:38.149301 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78f9ce-1a36-4a75-9e29-bcbebecb8509 service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:38.149649 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78f9ce-1a36-4a75-9e29-bcbebecb8509 service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:38.149932 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78f9ce-1a36-4a75-9e29-bcbebecb8509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:38.158736 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78f9ce-1a36-4a75-9e29-bcbebecb8509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:38.160201 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78f9ce-1a36-4a75-9e29-bcbebecb8509 service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:38.170319 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 538/1075] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:40.443730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0d384-5e32-4d80-b5fa-a120c51e1027 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:40.444283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0d384-5e32-4d80-b5fa-a120c51e1027 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:40.444283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0d384-5e32-4d80-b5fa-a120c51e1027 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:40.446449 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 538/1076] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:40.451561 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb46d8-40a7-47a8-95a5-95602741b0cf None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:40.451984 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb46d8-40a7-47a8-95a5-95602741b0cf None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:40.452098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb46d8-40a7-47a8-95a5-95602741b0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:40.459466 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=70 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:40.472414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-2cfb46d8-40a7-47a8-95a5-95602741b0cf None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:40.473618 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-2cfb46d8-40a7-47a8-95a5-95602741b0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:40.482269 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 539/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:53:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:40.520861 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0d384-5e32-4d80-b5fa-a120c51e1027 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:40.526350 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=73 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:40.532666 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0d384-5e32-4d80-b5fa-a120c51e1027 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:40.536185 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f574f-c284-4d60-8977-8868dd456402 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fa6f1c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:40.536788 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f574f-c284-4d60-8977-8868dd456402 service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:40.537066 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f574f-c284-4d60-8977-8868dd456402 service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:40.537337 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f574f-c284-4d60-8977-8868dd456402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:40.547107 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f574f-c284-4d60-8977-8868dd456402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:40.548538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f574f-c284-4d60-8977-8868dd456402 service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:40.558605 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 539/1078] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:42.851191 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0978d6-cfb5-4bf0-ab43-9abb61e5a607 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:42.851859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0978d6-cfb5-4bf0-ab43-9abb61e5a607 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:42.851859 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0978d6-cfb5-4bf0-ab43-9abb61e5a607 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:42.853174 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 540/1079] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:42.858548 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831e12d-23e4-4ffd-b9a4-7c2a076f43fb None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:42.859013 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831e12d-23e4-4ffd-b9a4-7c2a076f43fb None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:42.859119 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831e12d-23e4-4ffd-b9a4-7c2a076f43fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:42.877756 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-f831e12d-23e4-4ffd-b9a4-7c2a076f43fb None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:42.878973 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-f831e12d-23e4-4ffd-b9a4-7c2a076f43fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:42.887398 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 540/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:53:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:53:42.925552 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0978d6-cfb5-4bf0-ab43-9abb61e5a607 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:42.936252 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0978d6-cfb5-4bf0-ab43-9abb61e5a607 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:42.939714 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adec9e0-f9f5-4a77-b07c-1b3541864f28 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a0fc75fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:42.940315 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adec9e0-f9f5-4a77-b07c-1b3541864f28 service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:42.940600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adec9e0-f9f5-4a77-b07c-1b3541864f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:42.940872 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adec9e0-f9f5-4a77-b07c-1b3541864f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:42.950443 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adec9e0-f9f5-4a77-b07c-1b3541864f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:42.951871 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adec9e0-f9f5-4a77-b07c-1b3541864f28 service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:42.961893 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 541/1081] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:45.228350 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd37d8-e60d-4545-8808-c819fb8dac58 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:45.228927 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd37d8-e60d-4545-8808-c819fb8dac58 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:45.228927 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd37d8-e60d-4545-8808-c819fb8dac58 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:45.230339 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 541/1082] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:45.235437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208103e-c4f8-4dd7-82b6-d34e9c47a5ea None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:45.235863 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208103e-c4f8-4dd7-82b6-d34e9c47a5ea None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:45.236028 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208103e-c4f8-4dd7-82b6-d34e9c47a5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:45.255064 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-c208103e-c4f8-4dd7-82b6-d34e9c47a5ea None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:45.256998 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-c208103e-c4f8-4dd7-82b6-d34e9c47a5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:45.264877 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 542/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:53:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:45.302852 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd37d8-e60d-4545-8808-c819fb8dac58 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:45.313700 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd37d8-e60d-4545-8808-c819fb8dac58 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:45.317094 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda39301-d884-438b-847a-cc761b64ee7a service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a0fdc3a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:45.317725 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda39301-d884-438b-847a-cc761b64ee7a service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:45.318008 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda39301-d884-438b-847a-cc761b64ee7a service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:45.318280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda39301-d884-438b-847a-cc761b64ee7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:45.327923 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda39301-d884-438b-847a-cc761b64ee7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:45.329346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda39301-d884-438b-847a-cc761b64ee7a service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:45.339618 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 542/1084] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:47.576061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cd3c4-9ad7-4003-af7a-268e6ae373d2 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:47.576611 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cd3c4-9ad7-4003-af7a-268e6ae373d2 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:47.576611 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cd3c4-9ad7-4003-af7a-268e6ae373d2 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:47.577980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 543/1085] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:53:47.583156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a327856-b8a0-4e8f-a938-e14a5fc82b49 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:47.583577 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a327856-b8a0-4e8f-a938-e14a5fc82b49 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:47.583816 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a327856-b8a0-4e8f-a938-e14a5fc82b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:47.603448 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-4a327856-b8a0-4e8f-a938-e14a5fc82b49 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:47.604639 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-4a327856-b8a0-4e8f-a938-e14a5fc82b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:47.612421 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 543/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:53:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:47.651903 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cd3c4-9ad7-4003-af7a-268e6ae373d2 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:47.662481 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cd3c4-9ad7-4003-af7a-268e6ae373d2 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:47.666080 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926bc03b-c481-4448-9b3b-e518135367d3 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a0fd26b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:47.666685 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bc03b-c481-4448-9b3b-e518135367d3 service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:47.666968 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bc03b-c481-4448-9b3b-e518135367d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:47.667241 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926bc03b-c481-4448-9b3b-e518135367d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:47.675945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bc03b-c481-4448-9b3b-e518135367d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:47.677365 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926bc03b-c481-4448-9b3b-e518135367d3 service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:47.687491 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 544/1087] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:57.598716 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=17 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:57.683394 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=17 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:11.299622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0ffc4-b818-47a2-9b02-76ee34968040 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:11.300181 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0ffc4-b818-47a2-9b02-76ee34968040 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:11.300181 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0ffc4-b818-47a2-9b02-76ee34968040 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:11.301464 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 544/1088] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:54:11.307597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef661ef-4f50-4ccd-99cf-a1d22c6e0228 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:11.308092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef661ef-4f50-4ccd-99cf-a1d22c6e0228 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:11.308207 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef661ef-4f50-4ccd-99cf-a1d22c6e0228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:11.326804 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-bef661ef-4f50-4ccd-99cf-a1d22c6e0228 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:11.327992 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-bef661ef-4f50-4ccd-99cf-a1d22c6e0228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:11.336073 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 545/1089] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:54:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:11.386507 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cea30-ed88-4f7c-bd74-cade583eb663 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:11.386793 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cea30-ed88-4f7c-bd74-cade583eb663 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:11.387068 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cea30-ed88-4f7c-bd74-cade583eb663 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:11.388398 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 545/1090] 10.222.0.47 () {54 vars in 966 bytes} [Mon Jul 25 22:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:54:11.393534 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdedbd-69a2-4515-b2ea-fbfcbdb2e341 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:11.393863 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdedbd-69a2-4515-b2ea-fbfcbdb2e341 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:11.394146 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdedbd-69a2-4515-b2ea-fbfcbdb2e341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:11.414379 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-cdcdedbd-69a2-4515-b2ea-fbfcbdb2e341 None None] MFA Rules not processed for user `bea7c9ce1d3c4fe983e5944e5f92ff91`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:11.415570 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-cdcdedbd-69a2-4515-b2ea-fbfcbdb2e341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:11.421938 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 546/1091] 10.222.0.47 () {58 vars in 1063 bytes} [Mon Jul 25 22:54:11 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:11.430178 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cea30-ed88-4f7c-bd74-cade583eb663 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:11.441603 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cea30-ed88-4f7c-bd74-cade583eb663 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:11.445682 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed111a-d30e-49b7-999b-67284eda7593 service glance] RBAC: auth_context: {'token': <TokenModel (audit_id=GFsrx4iKQjumWmX1dJnP4w, audit_chain_id=['GFsrx4iKQjumWmX1dJnP4w']) at 0x7f8a0fa6fc10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bea7c9ce1d3c4fe983e5944e5f92ff91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:11.446278 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed111a-d30e-49b7-999b-67284eda7593 service glance] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:11.446558 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed111a-d30e-49b7-999b-67284eda7593 service glance] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:11.446827 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed111a-d30e-49b7-999b-67284eda7593 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:11.455469 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed111a-d30e-49b7-999b-67284eda7593 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:11.456886 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed111a-d30e-49b7-999b-67284eda7593 service glance] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:11.467002 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 546/1092] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:13.827455 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264af3c-ca16-4240-bc4d-d0c58139ca7f None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:13.828019 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264af3c-ca16-4240-bc4d-d0c58139ca7f None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:13.828019 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264af3c-ca16-4240-bc4d-d0c58139ca7f None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:13.829351 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 547/1093] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:54:13.835368 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429fe70-9042-4652-93c9-95789249d22a None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:13.835796 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429fe70-9042-4652-93c9-95789249d22a None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:13.835927 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429fe70-9042-4652-93c9-95789249d22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:13.862830 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-1429fe70-9042-4652-93c9-95789249d22a None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:13.866235 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-1429fe70-9042-4652-93c9-95789249d22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:13.874084 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 547/1094] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:54:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:13.899041 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264af3c-ca16-4240-bc4d-d0c58139ca7f None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:13.911685 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264af3c-ca16-4240-bc4d-d0c58139ca7f None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:13.916037 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6375ad-6358-4bfb-b7b3-10ef57d67d15 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=PNjnIRaXQ6-2ssCIDCjwkA, audit_chain_id=['PNjnIRaXQ6-2ssCIDCjwkA']) at 0x7f8a0fc834c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:13.916635 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6375ad-6358-4bfb-b7b3-10ef57d67d15 admin admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:13.916912 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6375ad-6358-4bfb-b7b3-10ef57d67d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:13.917181 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6375ad-6358-4bfb-b7b3-10ef57d67d15 admin admin] PATH_INFO: `/v3/projects` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:13.917899 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6375ad-6358-4bfb-b7b3-10ef57d67d15 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:13.919671 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: WARNING py.warnings [None req-bb6375ad-6358-4bfb-b7b3-10ef57d67d15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:54:13.919671 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: warnings.warn(msg) Jul 25 22:54:13.919671 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: Jul 25 22:54:13.920820 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6375ad-6358-4bfb-b7b3-10ef57d67d15 admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:13.939707 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 548/1095] 10.222.0.47 () {56 vars in 1108 bytes} [Mon Jul 25 22:54:13 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:54:16.204651 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c16d6-3939-4b52-86c5-76bb02d9274b None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:16.205208 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c16d6-3939-4b52-86c5-76bb02d9274b None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:16.205208 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c16d6-3939-4b52-86c5-76bb02d9274b None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:16.206595 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 548/1096] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:54:16.212070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19bba4-23f5-46b6-b46e-6a7ae49db4a2 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:16.212515 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19bba4-23f5-46b6-b46e-6a7ae49db4a2 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:16.212620 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19bba4-23f5-46b6-b46e-6a7ae49db4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:16.231547 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-4b19bba4-23f5-46b6-b46e-6a7ae49db4a2 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:16.232753 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-4b19bba4-23f5-46b6-b46e-6a7ae49db4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:16.241025 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 549/1097] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:54:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:54:16.284968 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c16d6-3939-4b52-86c5-76bb02d9274b None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:16.298326 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c16d6-3939-4b52-86c5-76bb02d9274b None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:16.303790 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c9c47-e92f-4db9-bc04-59d4c9429264 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=EuIKcMJpS6uru_OiCoau7Q, audit_chain_id=['EuIKcMJpS6uru_OiCoau7Q']) at 0x7f8a0fd5cd90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:16.304392 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c9c47-e92f-4db9-bc04-59d4c9429264 service nova] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:16.304675 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c9c47-e92f-4db9-bc04-59d4c9429264 service nova] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:16.304952 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c9c47-e92f-4db9-bc04-59d4c9429264 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:16.312884 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c9c47-e92f-4db9-bc04-59d4c9429264 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:16.314493 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c9c47-e92f-4db9-bc04-59d4c9429264 service nova] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:16.324420 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 549/1098] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:18.766497 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ada734-cdf5-4e2d-bf06-8b62a0417885 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:18.767202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ada734-cdf5-4e2d-bf06-8b62a0417885 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:18.767202 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ada734-cdf5-4e2d-bf06-8b62a0417885 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:18.768388 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 550/1099] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:54:18.777064 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff90d2b-ae64-4ec4-802c-e4eeb625053f None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:18.777636 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff90d2b-ae64-4ec4-802c-e4eeb625053f None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:18.777636 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff90d2b-ae64-4ec4-802c-e4eeb625053f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:18.799832 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-6ff90d2b-ae64-4ec4-802c-e4eeb625053f None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:18.801045 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-6ff90d2b-ae64-4ec4-802c-e4eeb625053f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:18.809629 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 550/1100] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:54:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:18.859891 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ada734-cdf5-4e2d-bf06-8b62a0417885 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:18.872388 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ada734-cdf5-4e2d-bf06-8b62a0417885 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:18.877307 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01086b8a-d232-41f3-8721-9247d6cd8424 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a140ba1f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:18.878340 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01086b8a-d232-41f3-8721-9247d6cd8424 service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:18.878819 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01086b8a-d232-41f3-8721-9247d6cd8424 service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:18.880060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01086b8a-d232-41f3-8721-9247d6cd8424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:18.892596 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01086b8a-d232-41f3-8721-9247d6cd8424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:18.894092 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01086b8a-d232-41f3-8721-9247d6cd8424 service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:18.904838 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 551/1101] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:21.222246 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18124b4c-7148-42ca-aeae-e98585868856 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:21.222776 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18124b4c-7148-42ca-aeae-e98585868856 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:21.222776 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18124b4c-7148-42ca-aeae-e98585868856 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:21.224145 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 551/1102] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:54:21.229520 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d14dd7-6ae4-42f6-b2fa-29546001da58 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:21.229973 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d14dd7-6ae4-42f6-b2fa-29546001da58 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:21.230274 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d14dd7-6ae4-42f6-b2fa-29546001da58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:21.256035 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-25d14dd7-6ae4-42f6-b2fa-29546001da58 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:21.257223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-25d14dd7-6ae4-42f6-b2fa-29546001da58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:21.264807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 552/1103] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:54:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:21.304763 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18124b4c-7148-42ca-aeae-e98585868856 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:21.315346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18124b4c-7148-42ca-aeae-e98585868856 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:21.319516 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad299f-3e3b-490e-953f-97fd7a64b75a service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a0fa25880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:21.320118 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad299f-3e3b-490e-953f-97fd7a64b75a service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:21.320403 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad299f-3e3b-490e-953f-97fd7a64b75a service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:21.320682 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad299f-3e3b-490e-953f-97fd7a64b75a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:21.329548 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad299f-3e3b-490e-953f-97fd7a64b75a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:21.331012 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad299f-3e3b-490e-953f-97fd7a64b75a service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:21.341691 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 552/1104] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:23.680189 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b11b8-270f-416c-8df9-8c01f71169cb None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:23.680740 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b11b8-270f-416c-8df9-8c01f71169cb None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:23.680740 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b11b8-270f-416c-8df9-8c01f71169cb None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:23.682135 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 553/1105] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:54:23.687245 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ee9b1-c8ec-45d8-bea6-f829ec5bc1a8 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:23.687651 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ee9b1-c8ec-45d8-bea6-f829ec5bc1a8 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:23.687796 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ee9b1-c8ec-45d8-bea6-f829ec5bc1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:23.707609 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-324ee9b1-c8ec-45d8-bea6-f829ec5bc1a8 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:23.708917 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-324ee9b1-c8ec-45d8-bea6-f829ec5bc1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:23.716505 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 553/1106] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:54:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:23.759076 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b11b8-270f-416c-8df9-8c01f71169cb None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:23.769628 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b11b8-270f-416c-8df9-8c01f71169cb None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:23.773167 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df088f4-3d32-48a9-9a6a-8c586ee1a615 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a0fe3f250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:23.774069 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df088f4-3d32-48a9-9a6a-8c586ee1a615 service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:23.774359 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df088f4-3d32-48a9-9a6a-8c586ee1a615 service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:23.774636 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df088f4-3d32-48a9-9a6a-8c586ee1a615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:23.783388 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df088f4-3d32-48a9-9a6a-8c586ee1a615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:23.784823 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df088f4-3d32-48a9-9a6a-8c586ee1a615 service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:23.794268 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 554/1107] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:54:26.357756 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55fda3-aaca-4de8-8cf1-a14840112e29 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:26.358281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55fda3-aaca-4de8-8cf1-a14840112e29 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:26.358281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55fda3-aaca-4de8-8cf1-a14840112e29 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:26.359581 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 554/1108] 10.222.0.47 () {54 vars in 926 bytes} [Mon Jul 25 22:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:54:26.365023 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e30314-2210-48be-8df0-ce7d218ac450 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:26.365429 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e30314-2210-48be-8df0-ce7d218ac450 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:26.365649 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e30314-2210-48be-8df0-ce7d218ac450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:26.385527 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-24e30314-2210-48be-8df0-ce7d218ac450 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:26.386753 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-24e30314-2210-48be-8df0-ce7d218ac450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:26.394437 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 555/1109] 10.222.0.47 () {58 vars in 1023 bytes} [Mon Jul 25 22:54:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:26.436712 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55fda3-aaca-4de8-8cf1-a14840112e29 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:26.447615 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55fda3-aaca-4de8-8cf1-a14840112e29 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:26.451014 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6e677-e463-4b32-a200-f1e3e4772886 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a0fd32d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:26.451610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6e677-e463-4b32-a200-f1e3e4772886 service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:26.451890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6e677-e463-4b32-a200-f1e3e4772886 service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:26.452168 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6e677-e463-4b32-a200-f1e3e4772886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:26.461130 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6e677-e463-4b32-a200-f1e3e4772886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:26.462575 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6e677-e463-4b32-a200-f1e3e4772886 service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:26.471813 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 555/1110] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:54:36.380827 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=33 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:36.467763 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=33 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:55.953403 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd2efa-0c4b-4549-865e-627ec984bae7 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:55.954060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd2efa-0c4b-4549-865e-627ec984bae7 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:55.954060 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd2efa-0c4b-4549-865e-627ec984bae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:55.973722 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-b3dd2efa-0c4b-4549-865e-627ec984bae7 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:55.974933 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-b3dd2efa-0c4b-4549-865e-627ec984bae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:55.983242 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 556/1111] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 22:55:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:55.991330 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b6b4b-8de8-45b5-9bb3-2970f221aa70 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:55.991840 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b6b4b-8de8-45b5-9bb3-2970f221aa70 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:55.991959 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b6b4b-8de8-45b5-9bb3-2970f221aa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:56.012131 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-d44b6b4b-8de8-45b5-9bb3-2970f221aa70 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:56.013319 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-d44b6b4b-8de8-45b5-9bb3-2970f221aa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:56.021137 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 556/1112] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 22:55:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:56.025764 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd2efa-0c4b-4549-865e-627ec984bae7 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:56.035561 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd2efa-0c4b-4549-865e-627ec984bae7 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:56.040158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9fce6-4ab7-456d-a380-edf370a37367 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=C8UUprK2RYO0u7BwcvzPcw, audit_chain_id=['C8UUprK2RYO0u7BwcvzPcw']) at 0x7f8a0fbc4af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:56.040769 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9fce6-4ab7-456d-a380-edf370a37367 admin admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:56.041053 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9fce6-4ab7-456d-a380-edf370a37367 admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:56.041328 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9fce6-4ab7-456d-a380-edf370a37367 admin admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:56.042055 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9fce6-4ab7-456d-a380-edf370a37367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:55:56.042423 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9fce6-4ab7-456d-a380-edf370a37367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:56.043602 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: WARNING py.warnings [None req-fda9fce6-4ab7-456d-a380-edf370a37367 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:55:56.043602 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: warnings.warn(msg) Jul 25 22:55:56.043602 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: Jul 25 22:55:56.044604 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9fce6-4ab7-456d-a380-edf370a37367 admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:56.057121 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 557/1113] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Jul 25 22:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:55:56.066200 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b6b4b-8de8-45b5-9bb3-2970f221aa70 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:56.075169 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b6b4b-8de8-45b5-9bb3-2970f221aa70 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:56.080781 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38484d-da84-4b64-a30c-5dd729e4fd60 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=C8UUprK2RYO0u7BwcvzPcw, audit_chain_id=['C8UUprK2RYO0u7BwcvzPcw']) at 0x7f8a0fd5c3a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:56.081387 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38484d-da84-4b64-a30c-5dd729e4fd60 admin admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:56.081701 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38484d-da84-4b64-a30c-5dd729e4fd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:56.081980 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38484d-da84-4b64-a30c-5dd729e4fd60 admin admin] PATH_INFO: `/v3/projects` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:56.082651 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38484d-da84-4b64-a30c-5dd729e4fd60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:56.084385 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: WARNING py.warnings [None req-ee38484d-da84-4b64-a30c-5dd729e4fd60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:55:56.084385 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: warnings.warn(msg) Jul 25 22:55:56.084385 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: Jul 25 22:55:56.085567 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38484d-da84-4b64-a30c-5dd729e4fd60 admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:56.113080 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 557/1114] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Jul 25 22:55:56 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:56.117370 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9fce6-4ab7-456d-a380-edf370a37367 admin admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:56.128962 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9fce6-4ab7-456d-a380-edf370a37367 admin admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:56.187847 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26763a58-0e54-4a21-a12c-270145275d54 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=C8UUprK2RYO0u7BwcvzPcw, audit_chain_id=['C8UUprK2RYO0u7BwcvzPcw']) at 0x7f8a0fc1db80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:56.188466 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26763a58-0e54-4a21-a12c-270145275d54 admin admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:56.188752 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26763a58-0e54-4a21-a12c-270145275d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:56.189031 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26763a58-0e54-4a21-a12c-270145275d54 admin admin] PATH_INFO: `/v3/users` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:56.189742 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26763a58-0e54-4a21-a12c-270145275d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:56.190758 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: WARNING py.warnings [None req-26763a58-0e54-4a21-a12c-270145275d54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:55:56.190758 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: warnings.warn(msg) Jul 25 22:55:56.190758 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: Jul 25 22:55:56.191965 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26763a58-0e54-4a21-a12c-270145275d54 admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:56.213420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 558/1115] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 22:55:56 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:55:56.218071 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38484d-da84-4b64-a30c-5dd729e4fd60 admin admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:56.228046 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38484d-da84-4b64-a30c-5dd729e4fd60 admin admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:56.234133 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5429b-1991-4ca7-9e3f-b2406ec9e06a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=C8UUprK2RYO0u7BwcvzPcw, audit_chain_id=['C8UUprK2RYO0u7BwcvzPcw']) at 0x7f8a0fc81160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:56.234776 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5429b-1991-4ca7-9e3f-b2406ec9e06a admin admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:56.235089 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5429b-1991-4ca7-9e3f-b2406ec9e06a admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:56.235369 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5429b-1991-4ca7-9e3f-b2406ec9e06a admin admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:56.236060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5429b-1991-4ca7-9e3f-b2406ec9e06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:56.237096 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: WARNING py.warnings [None req-07a5429b-1991-4ca7-9e3f-b2406ec9e06a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:55:56.237096 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: warnings.warn(msg) Jul 25 22:55:56.237096 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: Jul 25 22:55:56.238018 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5429b-1991-4ca7-9e3f-b2406ec9e06a admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:56.250990 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 558/1116] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:55:56.255219 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26763a58-0e54-4a21-a12c-270145275d54 admin admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:56.265420 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26763a58-0e54-4a21-a12c-270145275d54 admin admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:56.270013 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4160e33-10b0-4df4-bcb3-196516404019 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=C8UUprK2RYO0u7BwcvzPcw, audit_chain_id=['C8UUprK2RYO0u7BwcvzPcw']) at 0x7f8a0fc02160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:56.270633 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4160e33-10b0-4df4-bcb3-196516404019 admin admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:56.270918 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4160e33-10b0-4df4-bcb3-196516404019 admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:56.271200 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4160e33-10b0-4df4-bcb3-196516404019 admin admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:56.271892 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4160e33-10b0-4df4-bcb3-196516404019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:56.272900 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: WARNING py.warnings [None req-e4160e33-10b0-4df4-bcb3-196516404019 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:55:56.272900 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: warnings.warn(msg) Jul 25 22:55:56.272900 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: Jul 25 22:55:56.273809 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4160e33-10b0-4df4-bcb3-196516404019 admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:56.287474 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 559/1117] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Jul 25 22:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:55:56.291424 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5429b-1991-4ca7-9e3f-b2406ec9e06a admin admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:56.302174 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5429b-1991-4ca7-9e3f-b2406ec9e06a admin admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:56.306696 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917757f0-ddf6-4da3-aea6-bffe6c424457 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=C8UUprK2RYO0u7BwcvzPcw, audit_chain_id=['C8UUprK2RYO0u7BwcvzPcw']) at 0x7f8a0fa25af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:56.307343 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917757f0-ddf6-4da3-aea6-bffe6c424457 admin admin] REQUEST_METHOD: `PUT` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:56.307626 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917757f0-ddf6-4da3-aea6-bffe6c424457 admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:56.307905 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917757f0-ddf6-4da3-aea6-bffe6c424457 admin admin] PATH_INFO: `/v3/projects/b9534202c41243ecb4c5ba398816fcd7/users/b686cd7cd82047e18857dca8c1d61e15/roles/c57f45d724fe45009701c9b2706d661c` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:56.322586 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917757f0-ddf6-4da3-aea6-bffe6c424457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9534202c41243ecb4c5ba398816fcd7, user_id=b686cd7cd82047e18857dca8c1d61e15, role_id=c57f45d724fe45009701c9b2706d661c)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:56.323601 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: WARNING py.warnings [None req-917757f0-ddf6-4da3-aea6-bffe6c424457 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:55:56.323601 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: warnings.warn(msg) Jul 25 22:55:56.323601 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: Jul 25 22:55:56.325529 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917757f0-ddf6-4da3-aea6-bffe6c424457 admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:56.339436 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 559/1118] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Jul 25 22:55:56 2022] PUT /identity/v3/projects/b9534202c41243ecb4c5ba398816fcd7/users/b686cd7cd82047e18857dca8c1d61e15/roles/c57f45d724fe45009701c9b2706d661c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:55:56.352100 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c1398-85fe-440e-879a-936c2b7f9f0b None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:56.352398 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c1398-85fe-440e-879a-936c2b7f9f0b None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:56.352686 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c1398-85fe-440e-879a-936c2b7f9f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:56.381038 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-ea4c1398-85fe-440e-879a-936c2b7f9f0b None None] MFA Rules not processed for user `b686cd7cd82047e18857dca8c1d61e15`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:56.382276 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-ea4c1398-85fe-440e-879a-936c2b7f9f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:56.444874 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 560/1119] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 22:55:56 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:56.458764 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f35aa-0606-4a83-888f-86795575f2d9 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:56.459108 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f35aa-0606-4a83-888f-86795575f2d9 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:56.459397 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f35aa-0606-4a83-888f-86795575f2d9 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:56.460735 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 560/1120] 10.222.0.47 () {54 vars in 964 bytes} [Mon Jul 25 22:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:55:56.465654 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904249a-677b-4617-af01-c2e20aa28acf None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:56.465884 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904249a-677b-4617-af01-c2e20aa28acf None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:56.466163 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904249a-677b-4617-af01-c2e20aa28acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:56.485504 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-1904249a-677b-4617-af01-c2e20aa28acf None None] MFA Rules not processed for user `cc1a058881084fbdbf53096109e5381f`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:56.486719 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-1904249a-677b-4617-af01-c2e20aa28acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:56.530530 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:56.539121 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 561/1121] 10.222.0.47 () {58 vars in 1061 bytes} [Mon Jul 25 22:55:56 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:56.546876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f35aa-0606-4a83-888f-86795575f2d9 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:56.557294 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f35aa-0606-4a83-888f-86795575f2d9 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:56.561517 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbecb7-86f3-49d1-9e75-dcd7f6045a1c service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=RNKSBWKIQ5qI-uA1saN11Q, audit_chain_id=['RNKSBWKIQ5qI-uA1saN11Q']) at 0x7f8a0fccb5e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc1a058881084fbdbf53096109e5381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:56.562158 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbecb7-86f3-49d1-9e75-dcd7f6045a1c service cinder] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:56.562440 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbecb7-86f3-49d1-9e75-dcd7f6045a1c service cinder] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:56.562713 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbecb7-86f3-49d1-9e75-dcd7f6045a1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:56.570832 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbecb7-86f3-49d1-9e75-dcd7f6045a1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:56.572250 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbecb7-86f3-49d1-9e75-dcd7f6045a1c service cinder] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:56.581651 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 561/1122] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:56 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:56.621360 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb24ca6-bc4c-4757-b0eb-b43d7912d4df None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:56.621685 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb24ca6-bc4c-4757-b0eb-b43d7912d4df None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:56.621964 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb24ca6-bc4c-4757-b0eb-b43d7912d4df None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:56.623969 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 562/1123] 10.222.0.47 () {52 vars in 830 bytes} [Mon Jul 25 22:55:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:55:56.627990 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbecb7-86f3-49d1-9e75-dcd7f6045a1c service cinder] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:56.690571 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbecb7-86f3-49d1-9e75-dcd7f6045a1c service cinder] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:56.695158 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da2670-9acf-4be6-bb4d-913beaf9560c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=C8UUprK2RYO0u7BwcvzPcw, audit_chain_id=['C8UUprK2RYO0u7BwcvzPcw']) at 0x7f8a0fdd9a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:56.695797 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da2670-9acf-4be6-bb4d-913beaf9560c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:56.696083 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da2670-9acf-4be6-bb4d-913beaf9560c admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:56.696363 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da2670-9acf-4be6-bb4d-913beaf9560c admin admin] PATH_INFO: `/v3/users/b686cd7cd82047e18857dca8c1d61e15` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:56.697540 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da2670-9acf-4be6-bb4d-913beaf9560c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b686cd7cd82047e18857dca8c1d61e15)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:56.698585 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: WARNING py.warnings [None req-93da2670-9acf-4be6-bb4d-913beaf9560c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:55:56.698585 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: warnings.warn(msg) Jul 25 22:55:56.698585 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: Jul 25 22:55:56.699788 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da2670-9acf-4be6-bb4d-913beaf9560c admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:56.762056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-93da2670-9acf-4be6-bb4d-913beaf9560c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b686cd7cd82047e18857dca8c1d61e15'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:56.774152 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-93da2670-9acf-4be6-bb4d-913beaf9560c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b686cd7cd82047e18857dca8c1d61e15'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:56.774869 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-93da2670-9acf-4be6-bb4d-913beaf9560c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b686cd7cd82047e18857dca8c1d61e15'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:56.775576 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-93da2670-9acf-4be6-bb4d-913beaf9560c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b686cd7cd82047e18857dca8c1d61e15'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:56.793133 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-93da2670-9acf-4be6-bb4d-913beaf9560c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b686cd7cd82047e18857dca8c1d61e15'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:56.808895 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 562/1124] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Jul 25 22:55:56 2022] DELETE /identity/v3/users/b686cd7cd82047e18857dca8c1d61e15 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:55:56.814223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bca4ad-e5a9-45c0-aad2-d913e026442a None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:56.814537 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bca4ad-e5a9-45c0-aad2-d913e026442a None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:56.814820 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bca4ad-e5a9-45c0-aad2-d913e026442a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:56.835403 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-29bca4ad-e5a9-45c0-aad2-d913e026442a None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:55:56.836603 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-29bca4ad-e5a9-45c0-aad2-d913e026442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:56.895557 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 563/1125] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 22:55:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:55:56.905988 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da2670-9acf-4be6-bb4d-913beaf9560c admin admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:56.907383 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-93da2670-9acf-4be6-bb4d-913beaf9560c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:56.912763 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:56.967507 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da2670-9acf-4be6-bb4d-913beaf9560c admin admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:56.971128 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f44a2-826d-4472-be18-c75cdff8823c service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a0fe1e7c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:56.971777 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f44a2-826d-4472-be18-c75cdff8823c service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:56.972062 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f44a2-826d-4472-be18-c75cdff8823c service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:56.972343 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f44a2-826d-4472-be18-c75cdff8823c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:56.981120 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f44a2-826d-4472-be18-c75cdff8823c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:56.983228 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f44a2-826d-4472-be18-c75cdff8823c service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:56.992355 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 563/1126] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:55:57.350831 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bca4ad-e5a9-45c0-aad2-d913e026442a None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:57.352255 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-29bca4ad-e5a9-45c0-aad2-d913e026442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:55:57.365656 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bca4ad-e5a9-45c0-aad2-d913e026442a None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:57.370224 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b2606-a160-4876-a7d6-f791b4a3384c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=C8UUprK2RYO0u7BwcvzPcw, audit_chain_id=['C8UUprK2RYO0u7BwcvzPcw']) at 0x7f8a0fe47fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:57.370875 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b2606-a160-4876-a7d6-f791b4a3384c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:57.371159 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b2606-a160-4876-a7d6-f791b4a3384c admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:57.371436 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b2606-a160-4876-a7d6-f791b4a3384c admin admin] PATH_INFO: `/v3/projects/b9534202c41243ecb4c5ba398816fcd7` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:57.372877 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b2606-a160-4876-a7d6-f791b4a3384c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9534202c41243ecb4c5ba398816fcd7)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:57.374266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: WARNING py.warnings [None req-358b2606-a160-4876-a7d6-f791b4a3384c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:55:57.374266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: warnings.warn(msg) Jul 25 22:55:57.374266 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: Jul 25 22:55:57.375474 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b2606-a160-4876-a7d6-f791b4a3384c admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:57.437091 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-358b2606-a160-4876-a7d6-f791b4a3384c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9534202c41243ecb4c5ba398816fcd7', 'request_id': 'req-358b2606-a160-4876-a7d6-f791b4a3384c'} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:57.446494 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-358b2606-a160-4876-a7d6-f791b4a3384c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9534202c41243ecb4c5ba398816fcd7', 'request_id': 'req-358b2606-a160-4876-a7d6-f791b4a3384c'} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:57.452599 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-358b2606-a160-4876-a7d6-f791b4a3384c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9534202c41243ecb4c5ba398816fcd7', 'request_id': 'req-358b2606-a160-4876-a7d6-f791b4a3384c'} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:57.471421 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-358b2606-a160-4876-a7d6-f791b4a3384c admin admin] The token cache is being invalidate because project b9534202c41243ecb4c5ba398816fcd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:55:57.471709 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-358b2606-a160-4876-a7d6-f791b4a3384c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:57.472462 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-358b2606-a160-4876-a7d6-f791b4a3384c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:55:57.474016 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 564/1127] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Jul 25 22:55:57 2022] DELETE /identity/v3/projects/b9534202c41243ecb4c5ba398816fcd7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:56:06.988298 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=25 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:07.468441 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:21.589418 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33031463-ec85-4e70-8086-bf85ccd136bc None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:21.590029 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33031463-ec85-4e70-8086-bf85ccd136bc None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:21.590029 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33031463-ec85-4e70-8086-bf85ccd136bc None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:21.592285 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 564/1128] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:21.597235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b1d49-5534-4628-869a-1908ebb68798 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:21.597717 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b1d49-5534-4628-869a-1908ebb68798 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:21.597816 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b1d49-5534-4628-869a-1908ebb68798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:21.666359 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-9a2b1d49-5534-4628-869a-1908ebb68798 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:21.667571 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-9a2b1d49-5534-4628-869a-1908ebb68798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:21.760896 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 565/1129] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:57:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:21.921446 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33031463-ec85-4e70-8086-bf85ccd136bc None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:21.923570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-33031463-ec85-4e70-8086-bf85ccd136bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:22.012974 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33031463-ec85-4e70-8086-bf85ccd136bc None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:22.018046 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadecd73-b743-40a6-b8d1-fdebb6cb1bbb service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=EuIKcMJpS6uru_OiCoau7Q, audit_chain_id=['EuIKcMJpS6uru_OiCoau7Q']) at 0x7f8a14f6e700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:22.018666 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadecd73-b743-40a6-b8d1-fdebb6cb1bbb service nova] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:22.018953 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadecd73-b743-40a6-b8d1-fdebb6cb1bbb service nova] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:22.019234 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadecd73-b743-40a6-b8d1-fdebb6cb1bbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:22.027350 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadecd73-b743-40a6-b8d1-fdebb6cb1bbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:22.029189 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadecd73-b743-40a6-b8d1-fdebb6cb1bbb service nova] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:22.038377 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 565/1130] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:22.870304 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216a361-115a-41ba-9363-c25bcc112f32 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:22.870924 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216a361-115a-41ba-9363-c25bcc112f32 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:22.870924 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216a361-115a-41ba-9363-c25bcc112f32 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:22.872214 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 566/1131] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:22.877227 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8847eb9-6d3a-4380-b172-2e9df92f8286 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:22.877725 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8847eb9-6d3a-4380-b172-2e9df92f8286 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:22.877864 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8847eb9-6d3a-4380-b172-2e9df92f8286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:22.898164 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-d8847eb9-6d3a-4380-b172-2e9df92f8286 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:22.899358 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-d8847eb9-6d3a-4380-b172-2e9df92f8286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:22.908208 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 566/1132] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:57:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:23.070672 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216a361-115a-41ba-9363-c25bcc112f32 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:23.084674 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216a361-115a-41ba-9363-c25bcc112f32 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:23.089458 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efddd12-b991-4127-912a-f3119ef9147b service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=EuIKcMJpS6uru_OiCoau7Q, audit_chain_id=['EuIKcMJpS6uru_OiCoau7Q']) at 0x7f8a0fc83a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:23.090105 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efddd12-b991-4127-912a-f3119ef9147b service nova] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:23.090405 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efddd12-b991-4127-912a-f3119ef9147b service nova] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:23.090692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efddd12-b991-4127-912a-f3119ef9147b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:23.098574 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efddd12-b991-4127-912a-f3119ef9147b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:23.100158 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efddd12-b991-4127-912a-f3119ef9147b service nova] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:23.109217 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 567/1133] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:24.336329 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d038756-7de9-4204-a1d3-bfc4ccf7ef1b None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:24.336920 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d038756-7de9-4204-a1d3-bfc4ccf7ef1b None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:24.336920 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d038756-7de9-4204-a1d3-bfc4ccf7ef1b None None] PATH_INFO: `/v3` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:24.338235 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 567/1134] 10.222.0.52 () {54 vars in 925 bytes} [Mon Jul 25 22:57:24 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:57:24.344479 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc021f-b73c-4fbe-8051-2dd33089ebef None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:24.344945 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc021f-b73c-4fbe-8051-2dd33089ebef None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:24.345043 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc021f-b73c-4fbe-8051-2dd33089ebef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:24.374255 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-b5bc021f-b73c-4fbe-8051-2dd33089ebef None None] MFA Rules not processed for user `530c96407340435c982fd99367689007`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:24.375473 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-b5bc021f-b73c-4fbe-8051-2dd33089ebef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:24.428660 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:24.438750 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 568/1135] 10.222.0.52 () {58 vars in 1015 bytes} [Mon Jul 25 22:57:24 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:57:31.470038 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57993e-b860-41ed-a8db-8afbf2b56dcc None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:31.470570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57993e-b860-41ed-a8db-8afbf2b56dcc None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:31.470570 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57993e-b860-41ed-a8db-8afbf2b56dcc None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:31.471824 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 568/1136] 10.222.0.47 () {54 vars in 961 bytes} [Mon Jul 25 22:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:31.476941 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff98b42-25ca-4aec-9527-da94da4932e3 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:31.477404 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff98b42-25ca-4aec-9527-da94da4932e3 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:31.477523 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff98b42-25ca-4aec-9527-da94da4932e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:31.499395 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-cff98b42-25ca-4aec-9527-da94da4932e3 None None] MFA Rules not processed for user `530c96407340435c982fd99367689007`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:31.500604 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-cff98b42-25ca-4aec-9527-da94da4932e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:31.509025 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 569/1137] 10.222.0.47 () {58 vars in 1058 bytes} [Mon Jul 25 22:57:31 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:31.516587 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57993e-b860-41ed-a8db-8afbf2b56dcc None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:31.530246 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57993e-b860-41ed-a8db-8afbf2b56dcc None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:31.535238 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca108fa8-18f1-4d5e-a0df-abf3a8aaf438 service placement] RBAC: auth_context: {'token': <TokenModel (audit_id=uDdW4jsyRDiewx6tJs9J5g, audit_chain_id=['uDdW4jsyRDiewx6tJs9J5g']) at 0x7f8a0fc81b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530c96407340435c982fd99367689007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:31.535842 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca108fa8-18f1-4d5e-a0df-abf3a8aaf438 service placement] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:31.536128 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca108fa8-18f1-4d5e-a0df-abf3a8aaf438 service placement] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:31.536406 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca108fa8-18f1-4d5e-a0df-abf3a8aaf438 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:31.545143 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca108fa8-18f1-4d5e-a0df-abf3a8aaf438 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:31.546734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca108fa8-18f1-4d5e-a0df-abf3a8aaf438 service placement] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:31.556098 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 569/1138] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:31 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:34.361976 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cad72f-40b0-4c2d-82b3-950af2e98e39 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:34.362515 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cad72f-40b0-4c2d-82b3-950af2e98e39 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:34.362515 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cad72f-40b0-4c2d-82b3-950af2e98e39 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:34.363867 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 570/1139] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:34.368763 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa05ab2-93ce-41e9-91b8-8e24662bdb2c None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:34.369199 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa05ab2-93ce-41e9-91b8-8e24662bdb2c None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:34.369326 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa05ab2-93ce-41e9-91b8-8e24662bdb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:34.391073 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-bfa05ab2-93ce-41e9-91b8-8e24662bdb2c None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:34.392365 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-bfa05ab2-93ce-41e9-91b8-8e24662bdb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:34.400104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 570/1140] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:57:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:34.561599 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cad72f-40b0-4c2d-82b3-950af2e98e39 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:34.574748 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cad72f-40b0-4c2d-82b3-950af2e98e39 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:34.579996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84ffd0-8c11-4095-8644-ee0d7b2e8c50 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=EuIKcMJpS6uru_OiCoau7Q, audit_chain_id=['EuIKcMJpS6uru_OiCoau7Q']) at 0x7f8a155141f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:34.580622 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84ffd0-8c11-4095-8644-ee0d7b2e8c50 service nova] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:34.580909 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84ffd0-8c11-4095-8644-ee0d7b2e8c50 service nova] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:34.581184 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84ffd0-8c11-4095-8644-ee0d7b2e8c50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:34.589090 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84ffd0-8c11-4095-8644-ee0d7b2e8c50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:34.591332 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84ffd0-8c11-4095-8644-ee0d7b2e8c50 service nova] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:34.600430 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 571/1141] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:35.425322 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0bf7a-6d3b-4228-9e25-8166566423eb None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:35.425890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0bf7a-6d3b-4228-9e25-8166566423eb None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:35.425890 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0bf7a-6d3b-4228-9e25-8166566423eb None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:35.427163 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 571/1142] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:35.432225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d76ca-3e34-4cf0-b9f5-3162767d9cbb None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:35.432650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d76ca-3e34-4cf0-b9f5-3162767d9cbb None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:35.432786 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d76ca-3e34-4cf0-b9f5-3162767d9cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:35.452981 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-6d7d76ca-3e34-4cf0-b9f5-3162767d9cbb None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:35.454225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-6d7d76ca-3e34-4cf0-b9f5-3162767d9cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:35.462476 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 572/1143] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:57:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:35.620522 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0bf7a-6d3b-4228-9e25-8166566423eb None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:35.634650 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0bf7a-6d3b-4228-9e25-8166566423eb None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:35.640146 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d68a23-0b77-4411-b1e9-0e518b9eeb39 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=EuIKcMJpS6uru_OiCoau7Q, audit_chain_id=['EuIKcMJpS6uru_OiCoau7Q']) at 0x7f8a0f92d190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:35.640752 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d68a23-0b77-4411-b1e9-0e518b9eeb39 service nova] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:35.641029 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d68a23-0b77-4411-b1e9-0e518b9eeb39 service nova] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:35.641302 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d68a23-0b77-4411-b1e9-0e518b9eeb39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:35.649525 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d68a23-0b77-4411-b1e9-0e518b9eeb39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:35.651118 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d68a23-0b77-4411-b1e9-0e518b9eeb39 service nova] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:35.661074 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 572/1144] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:39.898018 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea49d6-d1ef-4b86-ba11-9feb63760ee0 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:39.898639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea49d6-d1ef-4b86-ba11-9feb63760ee0 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:39.898639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea49d6-d1ef-4b86-ba11-9feb63760ee0 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:39.899899 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 573/1145] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:39.906085 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fc044-7b31-4eee-b995-be83f4d0cc03 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:39.906538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fc044-7b31-4eee-b995-be83f4d0cc03 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:39.906643 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fc044-7b31-4eee-b995-be83f4d0cc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:40.053391 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-f54fc044-7b31-4eee-b995-be83f4d0cc03 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:40.054547 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-f54fc044-7b31-4eee-b995-be83f4d0cc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:40.062383 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 573/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:57:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:40.100624 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea49d6-d1ef-4b86-ba11-9feb63760ee0 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:40.102337 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-55ea49d6-d1ef-4b86-ba11-9feb63760ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:40.158788 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea49d6-d1ef-4b86-ba11-9feb63760ee0 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:40.162293 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02b248-637a-48a0-a3a8-150dcf4e1a4c service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a0fd1c1f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:40.162896 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02b248-637a-48a0-a3a8-150dcf4e1a4c service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:40.163176 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02b248-637a-48a0-a3a8-150dcf4e1a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:40.163452 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02b248-637a-48a0-a3a8-150dcf4e1a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:40.173956 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02b248-637a-48a0-a3a8-150dcf4e1a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:40.175374 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da02b248-637a-48a0-a3a8-150dcf4e1a4c service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:40.185863 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 574/1147] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:42.383588 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2926b-969f-4080-8e6d-de5bea72b230 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:42.384096 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2926b-969f-4080-8e6d-de5bea72b230 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:42.384217 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2926b-969f-4080-8e6d-de5bea72b230 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:42.385481 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 574/1148] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:42.391143 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7f3a5-bbb7-4ec1-922e-74dcd8644115 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:42.391532 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7f3a5-bbb7-4ec1-922e-74dcd8644115 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:42.391701 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7f3a5-bbb7-4ec1-922e-74dcd8644115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:42.411110 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-40c7f3a5-bbb7-4ec1-922e-74dcd8644115 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:42.412303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-40c7f3a5-bbb7-4ec1-922e-74dcd8644115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:42.420787 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 575/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:57:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:42.457485 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2926b-969f-4080-8e6d-de5bea72b230 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:42.468165 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2926b-969f-4080-8e6d-de5bea72b230 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:42.471761 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d45510-fd5c-40ba-9281-8aa48807976d service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a0fe32a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:42.472365 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d45510-fd5c-40ba-9281-8aa48807976d service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:42.472647 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d45510-fd5c-40ba-9281-8aa48807976d service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:42.472923 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d45510-fd5c-40ba-9281-8aa48807976d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:42.482860 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d45510-fd5c-40ba-9281-8aa48807976d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:42.484289 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d45510-fd5c-40ba-9281-8aa48807976d service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:42.493957 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 575/1150] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:46.350212 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2af497-5ce6-485e-bf84-c1de5d1a7433 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:46.350770 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2af497-5ce6-485e-bf84-c1de5d1a7433 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:46.350770 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2af497-5ce6-485e-bf84-c1de5d1a7433 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:46.352131 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 576/1151] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:46.358194 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec510743-e03a-4ead-bd14-715037009594 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:46.358586 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec510743-e03a-4ead-bd14-715037009594 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:46.358739 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec510743-e03a-4ead-bd14-715037009594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:46.378742 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-ec510743-e03a-4ead-bd14-715037009594 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:46.379932 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-ec510743-e03a-4ead-bd14-715037009594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:46.387940 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 576/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:57:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:46.666396 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2af497-5ce6-485e-bf84-c1de5d1a7433 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:46.668798 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-3c2af497-5ce6-485e-bf84-c1de5d1a7433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:46.732400 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2af497-5ce6-485e-bf84-c1de5d1a7433 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:46.735871 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a3743-2512-49c8-a573-f8f66f1b4dcc service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=sIAHV-EsQJKrufg4i7I-sw, audit_chain_id=['sIAHV-EsQJKrufg4i7I-sw']) at 0x7f8a0fdf03d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc1a058881084fbdbf53096109e5381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:46.736489 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a3743-2512-49c8-a573-f8f66f1b4dcc service cinder] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:46.736768 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a3743-2512-49c8-a573-f8f66f1b4dcc service cinder] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:46.737042 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a3743-2512-49c8-a573-f8f66f1b4dcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:46.746030 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a3743-2512-49c8-a573-f8f66f1b4dcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:46.748649 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a3743-2512-49c8-a573-f8f66f1b4dcc service cinder] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:46.758118 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 577/1153] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:49.017307 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6adc75d-e84f-4333-bc40-1e8172b0a2b0 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:49.017948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6adc75d-e84f-4333-bc40-1e8172b0a2b0 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:49.017948 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6adc75d-e84f-4333-bc40-1e8172b0a2b0 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:49.019227 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 577/1154] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:57:49.024438 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f57b08-fbcb-4466-a38a-9c32f9724e51 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:49.024839 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f57b08-fbcb-4466-a38a-9c32f9724e51 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:49.025000 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f57b08-fbcb-4466-a38a-9c32f9724e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:49.044748 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-91f57b08-fbcb-4466-a38a-9c32f9724e51 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:49.045979 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-91f57b08-fbcb-4466-a38a-9c32f9724e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:49.053835 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 578/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:57:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:57:49.325166 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6adc75d-e84f-4333-bc40-1e8172b0a2b0 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:49.326870 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-f6adc75d-e84f-4333-bc40-1e8172b0a2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:49.334569 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=70 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:49.341386 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6adc75d-e84f-4333-bc40-1e8172b0a2b0 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:49.344895 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11d307-bed1-4288-9b01-b9c1ad3504f7 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=RNKSBWKIQ5qI-uA1saN11Q, audit_chain_id=['RNKSBWKIQ5qI-uA1saN11Q']) at 0x7f8a0f974820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc1a058881084fbdbf53096109e5381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:49.345527 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11d307-bed1-4288-9b01-b9c1ad3504f7 service cinder] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:49.345841 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11d307-bed1-4288-9b01-b9c1ad3504f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:49.346119 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11d307-bed1-4288-9b01-b9c1ad3504f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:49.354936 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11d307-bed1-4288-9b01-b9c1ad3504f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:49.356389 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a11d307-bed1-4288-9b01-b9c1ad3504f7 service cinder] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:49.365656 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 578/1156] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:59.039059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=70 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:59.361559 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=5 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:07.368916 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34752665-5bba-4110-84fd-cf4d2f8f4831 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:07.369538 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34752665-5bba-4110-84fd-cf4d2f8f4831 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:07.369538 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34752665-5bba-4110-84fd-cf4d2f8f4831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:07.373118 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1d912-1d15-4244-ab98-49c6b8917ead None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:07.373562 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1d912-1d15-4244-ab98-49c6b8917ead None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:07.373692 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1d912-1d15-4244-ab98-49c6b8917ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:07.389038 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-34752665-5bba-4110-84fd-cf4d2f8f4831 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:07.392868 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-42d1d912-1d15-4244-ab98-49c6b8917ead None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:07.399919 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-34752665-5bba-4110-84fd-cf4d2f8f4831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:07.400061 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-42d1d912-1d15-4244-ab98-49c6b8917ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:07.408508 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 579/1158] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 22:59:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:59:07.408683 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 579/1158] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 22:59:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:07.417330 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db003fa0-fc80-468d-bc64-d1bb8ebf55bf None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:07.417518 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2899b9a-c2aa-4c88-bef3-8f171127f5c5 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:07.417724 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db003fa0-fc80-468d-bc64-d1bb8ebf55bf None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:07.417933 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2899b9a-c2aa-4c88-bef3-8f171127f5c5 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:07.418042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db003fa0-fc80-468d-bc64-d1bb8ebf55bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:07.418130 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2899b9a-c2aa-4c88-bef3-8f171127f5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:07.437326 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-db003fa0-fc80-468d-bc64-d1bb8ebf55bf None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:07.438565 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-db003fa0-fc80-468d-bc64-d1bb8ebf55bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:07.439778 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-d2899b9a-c2aa-4c88-bef3-8f171127f5c5 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:07.440942 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-d2899b9a-c2aa-4c88-bef3-8f171127f5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:07.446323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 580/1159] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 22:59:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:07.449066 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 580/1160] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 22:59:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:07.450829 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db003fa0-fc80-468d-bc64-d1bb8ebf55bf None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:07.453180 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2899b9a-c2aa-4c88-bef3-8f171127f5c5 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:07.461983 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db003fa0-fc80-468d-bc64-d1bb8ebf55bf None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:07.464106 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2899b9a-c2aa-4c88-bef3-8f171127f5c5 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:07.466603 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c99f25-134c-44f9-8790-3d182c81ebf4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v0R5rqPCQJ6JVXxopDE-sw, audit_chain_id=['v0R5rqPCQJ6JVXxopDE-sw']) at 0x7f8a0f92d370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:07.467221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c99f25-134c-44f9-8790-3d182c81ebf4 admin admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:07.467505 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c99f25-134c-44f9-8790-3d182c81ebf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:07.467783 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c99f25-134c-44f9-8790-3d182c81ebf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:07.468481 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c99f25-134c-44f9-8790-3d182c81ebf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93655) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:59:07.468660 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17e56d-bf34-47ec-ba89-50ce923081d5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=62cJw11fR7u8apeQrM0CVg, audit_chain_id=['62cJw11fR7u8apeQrM0CVg']) at 0x7f8a0fd83a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:07.468789 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c99f25-134c-44f9-8790-3d182c81ebf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:07.469275 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17e56d-bf34-47ec-ba89-50ce923081d5 admin admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:07.469560 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17e56d-bf34-47ec-ba89-50ce923081d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:07.469834 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: WARNING py.warnings [None req-d2c99f25-134c-44f9-8790-3d182c81ebf4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:59:07.469834 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: warnings.warn(msg) Jul 25 22:59:07.469834 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: Jul 25 22:59:07.470101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17e56d-bf34-47ec-ba89-50ce923081d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:07.470536 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17e56d-bf34-47ec-ba89-50ce923081d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93656) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:59:07.470718 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c99f25-134c-44f9-8790-3d182c81ebf4 admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:07.470837 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17e56d-bf34-47ec-ba89-50ce923081d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:07.472521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17e56d-bf34-47ec-ba89-50ce923081d5 admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:07.490545 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 581/1161] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Jul 25 22:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:59:07.490735 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 581/1162] 10.222.0.47 () {58 vars in 1153 bytes} [Mon Jul 25 22:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:59:07.492818 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c99f25-134c-44f9-8790-3d182c81ebf4 admin admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:07.493730 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17e56d-bf34-47ec-ba89-50ce923081d5 admin admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:07.502893 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c99f25-134c-44f9-8790-3d182c81ebf4 admin admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:07.503666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17e56d-bf34-47ec-ba89-50ce923081d5 admin admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:07.507513 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819cb04-907e-416d-baa8-d344b3535fa5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v0R5rqPCQJ6JVXxopDE-sw, audit_chain_id=['v0R5rqPCQJ6JVXxopDE-sw']) at 0x7f8a0f92db80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:07.508156 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819cb04-907e-416d-baa8-d344b3535fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:07.508312 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446d01d-9aa1-4a8b-8f44-ad540f371789 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=62cJw11fR7u8apeQrM0CVg, audit_chain_id=['62cJw11fR7u8apeQrM0CVg']) at 0x7f8a140eec70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:07.508440 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819cb04-907e-416d-baa8-d344b3535fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:07.508702 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819cb04-907e-416d-baa8-d344b3535fa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:07.508917 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446d01d-9aa1-4a8b-8f44-ad540f371789 admin admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:07.509206 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446d01d-9aa1-4a8b-8f44-ad540f371789 admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:07.509379 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819cb04-907e-416d-baa8-d344b3535fa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:07.509485 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446d01d-9aa1-4a8b-8f44-ad540f371789 admin admin] PATH_INFO: `/v3/projects` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:07.510156 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446d01d-9aa1-4a8b-8f44-ad540f371789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:07.511214 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: WARNING py.warnings [None req-1446d01d-9aa1-4a8b-8f44-ad540f371789 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:59:07.511214 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: warnings.warn(msg) Jul 25 22:59:07.511214 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: Jul 25 22:59:07.511622 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819cb04-907e-416d-baa8-d344b3535fa5 admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:07.512392 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446d01d-9aa1-4a8b-8f44-ad540f371789 admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:07.551047 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 582/1163] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Jul 25 22:59:07 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:59:07.555406 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446d01d-9aa1-4a8b-8f44-ad540f371789 admin admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:07.556899 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 582/1164] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Jul 25 22:59:07 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:59:07.560700 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819cb04-907e-416d-baa8-d344b3535fa5 admin admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:07.617818 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446d01d-9aa1-4a8b-8f44-ad540f371789 admin admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:07.622624 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afd6c4-c159-4a5d-83e5-21d720a81839 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=62cJw11fR7u8apeQrM0CVg, audit_chain_id=['62cJw11fR7u8apeQrM0CVg']) at 0x7f8a0fc0e670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:07.623241 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afd6c4-c159-4a5d-83e5-21d720a81839 admin admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:07.623528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afd6c4-c159-4a5d-83e5-21d720a81839 admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:07.623803 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afd6c4-c159-4a5d-83e5-21d720a81839 admin admin] PATH_INFO: `/v3/users` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:07.623926 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819cb04-907e-416d-baa8-d344b3535fa5 admin admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:07.624460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6afd6c4-c159-4a5d-83e5-21d720a81839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:07.626443 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6afd6c4-c159-4a5d-83e5-21d720a81839 admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:07.628579 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c44ceb-5365-4524-9a48-e9a51553af36 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v0R5rqPCQJ6JVXxopDE-sw, audit_chain_id=['v0R5rqPCQJ6JVXxopDE-sw']) at 0x7f8a0f92d7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:07.629195 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c44ceb-5365-4524-9a48-e9a51553af36 admin admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:07.629482 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c44ceb-5365-4524-9a48-e9a51553af36 admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:07.629792 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c44ceb-5365-4524-9a48-e9a51553af36 admin admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:07.630463 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c44ceb-5365-4524-9a48-e9a51553af36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:07.631475 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: WARNING py.warnings [None req-01c44ceb-5365-4524-9a48-e9a51553af36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:59:07.631475 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: warnings.warn(msg) Jul 25 22:59:07.631475 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: Jul 25 22:59:07.633701 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c44ceb-5365-4524-9a48-e9a51553af36 admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:07.650019 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 583/1165] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 22:59:07 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:59:07.654458 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afd6c4-c159-4a5d-83e5-21d720a81839 admin admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:07.657230 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 583/1166] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 22:59:07 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:59:07.660994 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c44ceb-5365-4524-9a48-e9a51553af36 admin admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:07.664152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afd6c4-c159-4a5d-83e5-21d720a81839 admin admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:07.668918 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a99d8-bf15-4bdb-a9c9-e8415a1ba486 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=62cJw11fR7u8apeQrM0CVg, audit_chain_id=['62cJw11fR7u8apeQrM0CVg']) at 0x7f8a0fd2ea30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:07.669465 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a99d8-bf15-4bdb-a9c9-e8415a1ba486 admin admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:07.669781 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a99d8-bf15-4bdb-a9c9-e8415a1ba486 admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:07.670057 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a99d8-bf15-4bdb-a9c9-e8415a1ba486 admin admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:07.670744 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a99d8-bf15-4bdb-a9c9-e8415a1ba486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:07.670944 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c44ceb-5365-4524-9a48-e9a51553af36 admin admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:07.672355 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a99d8-bf15-4bdb-a9c9-e8415a1ba486 admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:07.675532 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755745a-635c-498b-985c-0fd16264dfca admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v0R5rqPCQJ6JVXxopDE-sw, audit_chain_id=['v0R5rqPCQJ6JVXxopDE-sw']) at 0x7f8a0fa1aaf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:07.676134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755745a-635c-498b-985c-0fd16264dfca admin admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:07.676424 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755745a-635c-498b-985c-0fd16264dfca admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:07.676705 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755745a-635c-498b-985c-0fd16264dfca admin admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:07.677457 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755745a-635c-498b-985c-0fd16264dfca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:07.679219 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755745a-635c-498b-985c-0fd16264dfca admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:07.683863 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 584/1167] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:59:07.687724 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a99d8-bf15-4bdb-a9c9-e8415a1ba486 admin admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:07.689947 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 584/1168] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:59:07.693447 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755745a-635c-498b-985c-0fd16264dfca admin admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:07.699114 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a99d8-bf15-4bdb-a9c9-e8415a1ba486 admin admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:07.703444 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755745a-635c-498b-985c-0fd16264dfca admin admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:07.703878 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86d986-e92c-42c2-8f11-d032c4dc14c4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=62cJw11fR7u8apeQrM0CVg, audit_chain_id=['62cJw11fR7u8apeQrM0CVg']) at 0x7f8a0fb67b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:07.704493 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86d986-e92c-42c2-8f11-d032c4dc14c4 admin admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:07.704777 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86d986-e92c-42c2-8f11-d032c4dc14c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:07.705056 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86d986-e92c-42c2-8f11-d032c4dc14c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:07.705784 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86d986-e92c-42c2-8f11-d032c4dc14c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:07.707400 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d86d986-e92c-42c2-8f11-d032c4dc14c4 admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:07.708113 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4079b3a-425a-4185-9d5b-f00289bb7496 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v0R5rqPCQJ6JVXxopDE-sw, audit_chain_id=['v0R5rqPCQJ6JVXxopDE-sw']) at 0x7f8a0f9eadc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:07.708703 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4079b3a-425a-4185-9d5b-f00289bb7496 admin admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:07.708979 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4079b3a-425a-4185-9d5b-f00289bb7496 admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:07.709268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4079b3a-425a-4185-9d5b-f00289bb7496 admin admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:07.711163 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4079b3a-425a-4185-9d5b-f00289bb7496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:07.712855 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4079b3a-425a-4185-9d5b-f00289bb7496 admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:07.718070 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 585/1169] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:59:07.722116 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86d986-e92c-42c2-8f11-d032c4dc14c4 admin admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:07.726370 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 585/1170] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:59:07.727314 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4079b3a-425a-4185-9d5b-f00289bb7496 admin admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:07.732132 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86d986-e92c-42c2-8f11-d032c4dc14c4 admin admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:07.736532 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4079b3a-425a-4185-9d5b-f00289bb7496 admin admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:07.736776 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53162d-fa67-42a9-bb52-4cbba816ced4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=62cJw11fR7u8apeQrM0CVg, audit_chain_id=['62cJw11fR7u8apeQrM0CVg']) at 0x7f8a0fde2880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:07.737439 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53162d-fa67-42a9-bb52-4cbba816ced4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:07.737760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53162d-fa67-42a9-bb52-4cbba816ced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:07.738043 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53162d-fa67-42a9-bb52-4cbba816ced4 admin admin] PATH_INFO: `/v3/projects/530a3ef643e644139ab444eca394b407/users/51baecd04d6d4edd803afa43e8f7f1ba/roles/c57f45d724fe45009701c9b2706d661c` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:07.741054 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f361099-9ed2-4ccd-a4a9-599dd90f321e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v0R5rqPCQJ6JVXxopDE-sw, audit_chain_id=['v0R5rqPCQJ6JVXxopDE-sw']) at 0x7f8a0fa2e700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:07.741779 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f361099-9ed2-4ccd-a4a9-599dd90f321e admin admin] REQUEST_METHOD: `PUT` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:07.742060 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f361099-9ed2-4ccd-a4a9-599dd90f321e admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:07.742330 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f361099-9ed2-4ccd-a4a9-599dd90f321e admin admin] PATH_INFO: `/v3/projects/9b24bf80d32a4e9a8133d13422f731c5/users/c03cf4f5f0eb46f39f2fd3c55c9f4857/roles/c57f45d724fe45009701c9b2706d661c` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:07.753487 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53162d-fa67-42a9-bb52-4cbba816ced4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=530a3ef643e644139ab444eca394b407, user_id=51baecd04d6d4edd803afa43e8f7f1ba, role_id=c57f45d724fe45009701c9b2706d661c)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:07.754611 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: WARNING py.warnings [None req-dd53162d-fa67-42a9-bb52-4cbba816ced4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:59:07.754611 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: warnings.warn(msg) Jul 25 22:59:07.754611 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: Jul 25 22:59:07.756611 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53162d-fa67-42a9-bb52-4cbba816ced4 admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:07.756865 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f361099-9ed2-4ccd-a4a9-599dd90f321e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b24bf80d32a4e9a8133d13422f731c5, user_id=c03cf4f5f0eb46f39f2fd3c55c9f4857, role_id=c57f45d724fe45009701c9b2706d661c)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:07.760241 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f361099-9ed2-4ccd-a4a9-599dd90f321e admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:07.770305 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 586/1171] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:07 2022] PUT /identity/v3/projects/530a3ef643e644139ab444eca394b407/users/51baecd04d6d4edd803afa43e8f7f1ba/roles/c57f45d724fe45009701c9b2706d661c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:59:07.774650 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 586/1172] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:07 2022] PUT /identity/v3/projects/9b24bf80d32a4e9a8133d13422f731c5/users/c03cf4f5f0eb46f39f2fd3c55c9f4857/roles/c57f45d724fe45009701c9b2706d661c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:07.776163 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b95e9-87ae-4ccd-bbb3-b52dcdd0a019 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:07.776456 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b95e9-87ae-4ccd-bbb3-b52dcdd0a019 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:07.776738 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b95e9-87ae-4ccd-bbb3-b52dcdd0a019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:07.779089 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cd36c-424d-4607-80cd-9699aed9a3bc None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:07.779377 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cd36c-424d-4607-80cd-9699aed9a3bc None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:07.779729 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cd36c-424d-4607-80cd-9699aed9a3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:07.796169 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-5a9b95e9-87ae-4ccd-bbb3-b52dcdd0a019 None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:07.797322 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-815cd36c-424d-4607-80cd-9699aed9a3bc None None] MFA Rules not processed for user `21915d6d53c54080a8c4d15c72508181`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:07.797455 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-5a9b95e9-87ae-4ccd-bbb3-b52dcdd0a019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:07.798513 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-815cd36c-424d-4607-80cd-9699aed9a3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:07.841370 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:07.842134 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:07.860794 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 587/1173] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 22:59:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:59:07.866392 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 587/1174] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 22:59:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:07.871636 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b95e9-87ae-4ccd-bbb3-b52dcdd0a019 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:07.874321 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cd36c-424d-4607-80cd-9699aed9a3bc None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:07.875662 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-815cd36c-424d-4607-80cd-9699aed9a3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:07.927225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b95e9-87ae-4ccd-bbb3-b52dcdd0a019 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:07.930983 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b79017-1140-404c-9fb7-6b98879da572 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a0fc9f310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:07.931601 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b79017-1140-404c-9fb7-6b98879da572 service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:07.931880 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b79017-1140-404c-9fb7-6b98879da572 service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:07.932155 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b79017-1140-404c-9fb7-6b98879da572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:07.941141 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b79017-1140-404c-9fb7-6b98879da572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:07.942615 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b79017-1140-404c-9fb7-6b98879da572 service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:07.946068 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cd36c-424d-4607-80cd-9699aed9a3bc None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:07.949782 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdb3c6-9eac-4f80-8662-e9f8da9a7294 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a1408b7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:07.950400 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdb3c6-9eac-4f80-8662-e9f8da9a7294 service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:07.950685 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdb3c6-9eac-4f80-8662-e9f8da9a7294 service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:07.950967 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdb3c6-9eac-4f80-8662-e9f8da9a7294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:07.952433 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 588/1175] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:59:07.960158 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdb3c6-9eac-4f80-8662-e9f8da9a7294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:07.962477 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdb3c6-9eac-4f80-8662-e9f8da9a7294 service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:07.971955 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 588/1176] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:59:13.972566 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ae1dd-5ae4-48a9-b69f-07f9ce0eff73 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:13.973113 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ae1dd-5ae4-48a9-b69f-07f9ce0eff73 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:13.973113 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ae1dd-5ae4-48a9-b69f-07f9ce0eff73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:14.024544 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-803ae1dd-5ae4-48a9-b69f-07f9ce0eff73 None None] MFA Rules not processed for user `51baecd04d6d4edd803afa43e8f7f1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:14.029963 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-803ae1dd-5ae4-48a9-b69f-07f9ce0eff73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:14.104475 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b20cb-4c21-4195-a1b9-8caaf6c49c2c None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:14.105062 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b20cb-4c21-4195-a1b9-8caaf6c49c2c None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:14.105062 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b20cb-4c21-4195-a1b9-8caaf6c49c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:14.145751 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 589/1177] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 22:59:13 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:14.146670 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ae1dd-5ae4-48a9-b69f-07f9ce0eff73 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:14.149053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-592b20cb-4c21-4195-a1b9-8caaf6c49c2c None None] MFA Rules not processed for user `c03cf4f5f0eb46f39f2fd3c55c9f4857`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:14.150275 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-592b20cb-4c21-4195-a1b9-8caaf6c49c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:14.167045 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ae1dd-5ae4-48a9-b69f-07f9ce0eff73 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:14.175480 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ee004-b667-4f5d-a580-2a2cf945d21e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=62cJw11fR7u8apeQrM0CVg, audit_chain_id=['62cJw11fR7u8apeQrM0CVg']) at 0x7f8a0fe47fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:14.176390 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ee004-b667-4f5d-a580-2a2cf945d21e admin admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:14.177249 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ee004-b667-4f5d-a580-2a2cf945d21e admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:14.177666 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ee004-b667-4f5d-a580-2a2cf945d21e admin admin] PATH_INFO: `/v3/projects` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:14.178472 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ee004-b667-4f5d-a580-2a2cf945d21e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:14.180967 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ee004-b667-4f5d-a580-2a2cf945d21e admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:14.215485 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 590/1178] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Jul 25 22:59:14 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:59:14.219471 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ee004-b667-4f5d-a580-2a2cf945d21e admin admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:14.248247 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 589/1179] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 22:59:14 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:59:14.253912 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b20cb-4c21-4195-a1b9-8caaf6c49c2c None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:14.271726 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b20cb-4c21-4195-a1b9-8caaf6c49c2c None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:14.311088 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:14.317117 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ee004-b667-4f5d-a580-2a2cf945d21e admin admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:14.333061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e732530-7bb4-4328-b655-3710184575f5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=62cJw11fR7u8apeQrM0CVg, audit_chain_id=['62cJw11fR7u8apeQrM0CVg']) at 0x7f8a0fc1d970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:14.335641 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e732530-7bb4-4328-b655-3710184575f5 admin admin] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:14.336294 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e732530-7bb4-4328-b655-3710184575f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:14.336786 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e732530-7bb4-4328-b655-3710184575f5 admin admin] PATH_INFO: `/v3/users` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:14.337792 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e732530-7bb4-4328-b655-3710184575f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:14.344115 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e732530-7bb4-4328-b655-3710184575f5 admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:14.365652 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47d43a-d493-49be-9a44-4422a47ac133 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v0R5rqPCQJ6JVXxopDE-sw, audit_chain_id=['v0R5rqPCQJ6JVXxopDE-sw']) at 0x7f8a0f9cd3a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:14.367610 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47d43a-d493-49be-9a44-4422a47ac133 admin admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:14.369920 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47d43a-d493-49be-9a44-4422a47ac133 admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:14.370501 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47d43a-d493-49be-9a44-4422a47ac133 admin admin] PATH_INFO: `/v3/projects` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:14.371213 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47d43a-d493-49be-9a44-4422a47ac133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:14.373163 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47d43a-d493-49be-9a44-4422a47ac133 admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:14.389999 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 591/1180] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 22:59:14 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:59:14.390893 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:14.391023 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e732530-7bb4-4328-b655-3710184575f5 admin admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:14.408207 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 590/1181] 10.222.0.47 () {60 vars in 1153 bytes} [Mon Jul 25 22:59:14 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:59:14.409857 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e732530-7bb4-4328-b655-3710184575f5 admin admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:14.413132 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47d43a-d493-49be-9a44-4422a47ac133 admin admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:14.514340 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cdac5-80de-4b34-9e3d-b191a272f93b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=62cJw11fR7u8apeQrM0CVg, audit_chain_id=['62cJw11fR7u8apeQrM0CVg']) at 0x7f8a0fe42cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:14.515203 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cdac5-80de-4b34-9e3d-b191a272f93b admin admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:14.515685 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cdac5-80de-4b34-9e3d-b191a272f93b admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:14.516126 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cdac5-80de-4b34-9e3d-b191a272f93b admin admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:14.516977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cdac5-80de-4b34-9e3d-b191a272f93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:14.521251 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cdac5-80de-4b34-9e3d-b191a272f93b admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:14.521693 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47d43a-d493-49be-9a44-4422a47ac133 admin admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:14.527511 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d15de5-f3aa-46e6-b05c-4736b1d07bfb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v0R5rqPCQJ6JVXxopDE-sw, audit_chain_id=['v0R5rqPCQJ6JVXxopDE-sw']) at 0x7f8a142ed430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:14.528152 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d15de5-f3aa-46e6-b05c-4736b1d07bfb admin admin] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:14.528458 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d15de5-f3aa-46e6-b05c-4736b1d07bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:14.528734 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d15de5-f3aa-46e6-b05c-4736b1d07bfb admin admin] PATH_INFO: `/v3/users` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:14.529408 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d15de5-f3aa-46e6-b05c-4736b1d07bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:14.531695 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d15de5-f3aa-46e6-b05c-4736b1d07bfb admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:14.535828 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 592/1182] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:59:14.540980 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cdac5-80de-4b34-9e3d-b191a272f93b admin admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:14.556625 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cdac5-80de-4b34-9e3d-b191a272f93b admin admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:14.564389 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1d47d-d7c8-42ac-8e3c-3d54652caf08 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=62cJw11fR7u8apeQrM0CVg, audit_chain_id=['62cJw11fR7u8apeQrM0CVg']) at 0x7f8a0fb146a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:14.565358 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1d47d-d7c8-42ac-8e3c-3d54652caf08 admin admin] REQUEST_METHOD: `PUT` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:14.565677 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1d47d-d7c8-42ac-8e3c-3d54652caf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:14.565964 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1d47d-d7c8-42ac-8e3c-3d54652caf08 admin admin] PATH_INFO: `/v3/projects/1c1e535cd5814d1693f189b064d1656b/users/a2bbe8186fa849fdb221ca4a15b95503/roles/6ca03befbf3a456eae350bc7e583488f` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:14.576246 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 591/1183] 10.222.0.47 () {60 vars in 1144 bytes} [Mon Jul 25 22:59:14 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:59:14.578023 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d15de5-f3aa-46e6-b05c-4736b1d07bfb admin admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:14.587426 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1d47d-d7c8-42ac-8e3c-3d54652caf08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1e535cd5814d1693f189b064d1656b, user_id=a2bbe8186fa849fdb221ca4a15b95503, role_id=6ca03befbf3a456eae350bc7e583488f)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:14.591446 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d15de5-f3aa-46e6-b05c-4736b1d07bfb admin admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:14.592375 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1d47d-d7c8-42ac-8e3c-3d54652caf08 admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:14.603193 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1f1aa-9a2b-4be8-8988-1c12328ea6a7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v0R5rqPCQJ6JVXxopDE-sw, audit_chain_id=['v0R5rqPCQJ6JVXxopDE-sw']) at 0x7f8a142edd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:14.604182 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1f1aa-9a2b-4be8-8988-1c12328ea6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:14.604579 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1f1aa-9a2b-4be8-8988-1c12328ea6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:14.605331 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1f1aa-9a2b-4be8-8988-1c12328ea6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:14.606365 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1f1aa-9a2b-4be8-8988-1c12328ea6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:14.620896 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1f1aa-9a2b-4be8-8988-1c12328ea6a7 admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:14.636803 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 592/1184] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:59:14.641177 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1f1aa-9a2b-4be8-8988-1c12328ea6a7 admin admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:14.648464 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 593/1185] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:14 2022] PUT /identity/v3/projects/1c1e535cd5814d1693f189b064d1656b/users/a2bbe8186fa849fdb221ca4a15b95503/roles/6ca03befbf3a456eae350bc7e583488f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:59:14.652298 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1d47d-d7c8-42ac-8e3c-3d54652caf08 admin admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:14.667671 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1f1aa-9a2b-4be8-8988-1c12328ea6a7 admin admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:14.739720 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1d47d-d7c8-42ac-8e3c-3d54652caf08 admin admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:14.745770 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f79059-091d-4be7-b16a-3757db5ceffd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=62cJw11fR7u8apeQrM0CVg, audit_chain_id=['62cJw11fR7u8apeQrM0CVg']) at 0x7f8a141a1700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:14.746463 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f79059-091d-4be7-b16a-3757db5ceffd admin admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:14.746750 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f79059-091d-4be7-b16a-3757db5ceffd admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:14.747188 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f79059-091d-4be7-b16a-3757db5ceffd admin admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:14.747893 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f79059-091d-4be7-b16a-3757db5ceffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:14.749528 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f79059-091d-4be7-b16a-3757db5ceffd admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:14.767326 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 594/1186] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:59:14.774611 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0da5c-4b58-4367-a3d3-7aa0468cc241 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v0R5rqPCQJ6JVXxopDE-sw, audit_chain_id=['v0R5rqPCQJ6JVXxopDE-sw']) at 0x7f8a0fa398e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:14.775330 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0da5c-4b58-4367-a3d3-7aa0468cc241 admin admin] REQUEST_METHOD: `PUT` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:14.775619 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0da5c-4b58-4367-a3d3-7aa0468cc241 admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:14.775903 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0da5c-4b58-4367-a3d3-7aa0468cc241 admin admin] PATH_INFO: `/v3/projects/97b05b7c37c54401820b12e4240c6de8/users/1c4034e95f404cfd814cc2ba03158de2/roles/6ca03befbf3a456eae350bc7e583488f` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:14.776991 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f79059-091d-4be7-b16a-3757db5ceffd admin admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:14.793151 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f79059-091d-4be7-b16a-3757db5ceffd admin admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:14.796054 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0da5c-4b58-4367-a3d3-7aa0468cc241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b05b7c37c54401820b12e4240c6de8, user_id=1c4034e95f404cfd814cc2ba03158de2, role_id=6ca03befbf3a456eae350bc7e583488f)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:14.797962 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adb859-84c7-4adc-8f4f-b25b9e90a104 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=62cJw11fR7u8apeQrM0CVg, audit_chain_id=['62cJw11fR7u8apeQrM0CVg']) at 0x7f8a14dd0100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:14.798639 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adb859-84c7-4adc-8f4f-b25b9e90a104 admin admin] REQUEST_METHOD: `PUT` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:14.798927 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adb859-84c7-4adc-8f4f-b25b9e90a104 admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:14.799201 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adb859-84c7-4adc-8f4f-b25b9e90a104 admin admin] PATH_INFO: `/v3/projects/1c1e535cd5814d1693f189b064d1656b/users/a2bbe8186fa849fdb221ca4a15b95503/roles/6ca03befbf3a456eae350bc7e583488f` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:14.801451 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adb859-84c7-4adc-8f4f-b25b9e90a104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1e535cd5814d1693f189b064d1656b, user_id=a2bbe8186fa849fdb221ca4a15b95503, role_id=6ca03befbf3a456eae350bc7e583488f)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:14.803353 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0da5c-4b58-4367-a3d3-7aa0468cc241 admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:14.804961 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68adb859-84c7-4adc-8f4f-b25b9e90a104 admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:14.823490 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 595/1187] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:14 2022] PUT /identity/v3/projects/1c1e535cd5814d1693f189b064d1656b/users/a2bbe8186fa849fdb221ca4a15b95503/roles/6ca03befbf3a456eae350bc7e583488f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:14.830271 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 593/1188] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:14 2022] PUT /identity/v3/projects/97b05b7c37c54401820b12e4240c6de8/users/1c4034e95f404cfd814cc2ba03158de2/roles/6ca03befbf3a456eae350bc7e583488f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:59:14.831699 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adb859-84c7-4adc-8f4f-b25b9e90a104 admin admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:14.886385 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:14.918561 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adb859-84c7-4adc-8f4f-b25b9e90a104 admin admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:14.994115 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923064b-b2ad-4c78-b300-13c49dc79b29 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v0R5rqPCQJ6JVXxopDE-sw, audit_chain_id=['v0R5rqPCQJ6JVXxopDE-sw']) at 0x7f8a0fb298e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:14.994865 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923064b-b2ad-4c78-b300-13c49dc79b29 admin admin] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:14.995065 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923064b-b2ad-4c78-b300-13c49dc79b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:14.995589 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923064b-b2ad-4c78-b300-13c49dc79b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:14.996288 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923064b-b2ad-4c78-b300-13c49dc79b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:14.998014 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923064b-b2ad-4c78-b300-13c49dc79b29 admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:15.011052 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 596/1189] 10.222.0.47 () {58 vars in 1122 bytes} [Mon Jul 25 22:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:59:15.015541 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0da5c-4b58-4367-a3d3-7aa0468cc241 admin admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:15.027175 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0da5c-4b58-4367-a3d3-7aa0468cc241 admin admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:15.033755 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff7ce2-a2d6-4b7f-98c6-94576530a1d5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v0R5rqPCQJ6JVXxopDE-sw, audit_chain_id=['v0R5rqPCQJ6JVXxopDE-sw']) at 0x7f8a14202700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:15.034453 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff7ce2-a2d6-4b7f-98c6-94576530a1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:15.034736 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff7ce2-a2d6-4b7f-98c6-94576530a1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:15.035024 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff7ce2-a2d6-4b7f-98c6-94576530a1d5 admin admin] PATH_INFO: `/v3/projects/97b05b7c37c54401820b12e4240c6de8/users/1c4034e95f404cfd814cc2ba03158de2/roles/6ca03befbf3a456eae350bc7e583488f` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:15.037017 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff7ce2-a2d6-4b7f-98c6-94576530a1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b05b7c37c54401820b12e4240c6de8, user_id=1c4034e95f404cfd814cc2ba03158de2, role_id=6ca03befbf3a456eae350bc7e583488f)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:15.040819 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff7ce2-a2d6-4b7f-98c6-94576530a1d5 admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:15.080262 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 594/1190] 10.222.0.47 () {60 vars in 1483 bytes} [Mon Jul 25 22:59:15 2022] PUT /identity/v3/projects/97b05b7c37c54401820b12e4240c6de8/users/1c4034e95f404cfd814cc2ba03158de2/roles/6ca03befbf3a456eae350bc7e583488f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:59:20.721597 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8566d-56f1-47f6-ba3c-f18ecddadb8e None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:20.722247 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8566d-56f1-47f6-ba3c-f18ecddadb8e None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:20.722247 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8566d-56f1-47f6-ba3c-f18ecddadb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:20.953137 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-cac8566d-56f1-47f6-ba3c-f18ecddadb8e None None] MFA Rules not processed for user `a2bbe8186fa849fdb221ca4a15b95503`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:20.955642 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-cac8566d-56f1-47f6-ba3c-f18ecddadb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:21.106836 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284da71-5170-4e33-b118-381160366210 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:21.107275 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284da71-5170-4e33-b118-381160366210 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:21.107459 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284da71-5170-4e33-b118-381160366210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:21.115117 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 597/1191] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 22:59:20 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:21.132422 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8566d-56f1-47f6-ba3c-f18ecddadb8e None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:21.134916 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-cac8566d-56f1-47f6-ba3c-f18ecddadb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:21.153853 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-2284da71-5170-4e33-b118-381160366210 None None] MFA Rules not processed for user `1c4034e95f404cfd814cc2ba03158de2`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:21.155283 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-2284da71-5170-4e33-b118-381160366210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:21.212509 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:21.281875 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8566d-56f1-47f6-ba3c-f18ecddadb8e None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:21.285853 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158bd30-b34f-4734-951f-94c90e5b29c2 service glance] RBAC: auth_context: {'token': <TokenModel (audit_id=GFsrx4iKQjumWmX1dJnP4w, audit_chain_id=['GFsrx4iKQjumWmX1dJnP4w']) at 0x7f8a1419e2e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bea7c9ce1d3c4fe983e5944e5f92ff91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:21.286486 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158bd30-b34f-4734-951f-94c90e5b29c2 service glance] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:21.286798 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158bd30-b34f-4734-951f-94c90e5b29c2 service glance] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:21.287046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158bd30-b34f-4734-951f-94c90e5b29c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:21.300843 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 595/1192] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 22:59:21 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:59:21.306459 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=100 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:21.317342 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284da71-5170-4e33-b118-381160366210 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:21.319204 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-2284da71-5170-4e33-b118-381160366210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:21.335813 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284da71-5170-4e33-b118-381160366210 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:21.340278 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06328191-610d-4523-8f53-c72ae6f06462 service glance] RBAC: auth_context: {'token': <TokenModel (audit_id=EU2NQN1wTmmvvXmGu-AJxA, audit_chain_id=['EU2NQN1wTmmvvXmGu-AJxA']) at 0x7f8a0f99e460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bea7c9ce1d3c4fe983e5944e5f92ff91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:21.341059 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06328191-610d-4523-8f53-c72ae6f06462 service glance] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:21.341465 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06328191-610d-4523-8f53-c72ae6f06462 service glance] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:21.341777 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06328191-610d-4523-8f53-c72ae6f06462 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:21.388650 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158bd30-b34f-4734-951f-94c90e5b29c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:21.392098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158bd30-b34f-4734-951f-94c90e5b29c2 service glance] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:21.407223 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 598/1193] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:21 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:21.423921 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06328191-610d-4523-8f53-c72ae6f06462 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:21.425756 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06328191-610d-4523-8f53-c72ae6f06462 service glance] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:21.441564 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 596/1194] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:21 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:30.485107 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124faab-5ef1-494f-a6ed-187fbf77ee32 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:30.485697 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124faab-5ef1-494f-a6ed-187fbf77ee32 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:30.485697 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124faab-5ef1-494f-a6ed-187fbf77ee32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:30.507705 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-d124faab-5ef1-494f-a6ed-187fbf77ee32 None None] MFA Rules not processed for user `c03cf4f5f0eb46f39f2fd3c55c9f4857`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:30.508850 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-d124faab-5ef1-494f-a6ed-187fbf77ee32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:30.521719 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 599/1195] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 22:59:30 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:30.822390 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c291cf-5c6d-4ecd-bc1a-53bcf9976174 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:30.822934 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c291cf-5c6d-4ecd-bc1a-53bcf9976174 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:30.823202 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c291cf-5c6d-4ecd-bc1a-53bcf9976174 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:30.824627 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 597/1196] 10.222.0.47 () {54 vars in 962 bytes} [Mon Jul 25 22:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:59:30.830050 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c7fb8-8863-4394-b026-97fb647db32e None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:30.830333 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c7fb8-8863-4394-b026-97fb647db32e None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:30.830606 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c7fb8-8863-4394-b026-97fb647db32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:30.862260 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-e64c7fb8-8863-4394-b026-97fb647db32e None None] MFA Rules not processed for user `a2528d7506a5481f8fa6bb5012b4a9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:30.863912 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-e64c7fb8-8863-4394-b026-97fb647db32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:30.935800 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 600/1197] 10.222.0.47 () {58 vars in 1059 bytes} [Mon Jul 25 22:59:30 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:59:30.941292 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd91a14-bf9d-4de0-b241-5dda9d154b6d None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:30.941606 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd91a14-bf9d-4de0-b241-5dda9d154b6d None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:30.941920 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd91a14-bf9d-4de0-b241-5dda9d154b6d None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:30.943393 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 598/1198] 10.222.0.47 () {54 vars in 912 bytes} [Mon Jul 25 22:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:59:30.948804 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50438-5503-4891-838d-efe78e915755 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:30.949100 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50438-5503-4891-838d-efe78e915755 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:30.949403 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50438-5503-4891-838d-efe78e915755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:30.970264 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-8db50438-5503-4891-838d-efe78e915755 None None] MFA Rules not processed for user `a2528d7506a5481f8fa6bb5012b4a9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:30.971492 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-8db50438-5503-4891-838d-efe78e915755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:30.980649 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 601/1199] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Jul 25 22:59:30 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:30.992977 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd91a14-bf9d-4de0-b241-5dda9d154b6d None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:31.004046 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd91a14-bf9d-4de0-b241-5dda9d154b6d None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:31.008168 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5254cb-f2d9-4b4a-a656-6c459b973a15 service glance] RBAC: auth_context: {'token': <TokenModel (audit_id=EU2NQN1wTmmvvXmGu-AJxA, audit_chain_id=['EU2NQN1wTmmvvXmGu-AJxA']) at 0x7f8a0f900550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bea7c9ce1d3c4fe983e5944e5f92ff91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:31.008805 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5254cb-f2d9-4b4a-a656-6c459b973a15 service glance] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:31.009087 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5254cb-f2d9-4b4a-a656-6c459b973a15 service glance] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:31.009366 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5254cb-f2d9-4b4a-a656-6c459b973a15 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:31.019138 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5254cb-f2d9-4b4a-a656-6c459b973a15 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:31.020804 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5254cb-f2d9-4b4a-a656-6c459b973a15 service glance] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:31.031519 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 599/1200] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:30 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:31.380866 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f4702-d341-4ab0-9498-9675c8502c87 None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:31.381163 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f4702-d341-4ab0-9498-9675c8502c87 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:31.381452 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f4702-d341-4ab0-9498-9675c8502c87 None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:31.382832 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 602/1201] 10.222.0.47 () {54 vars in 912 bytes} [Mon Jul 25 22:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:59:31.388425 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ffc18-e0db-4a15-917c-f33839b1c393 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:31.388956 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ffc18-e0db-4a15-917c-f33839b1c393 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:31.389414 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ffc18-e0db-4a15-917c-f33839b1c393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:31.419064 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-538ffc18-e0db-4a15-917c-f33839b1c393 None None] MFA Rules not processed for user `f77ef50984084af9bcd220fc68deacf8`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:31.421274 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-538ffc18-e0db-4a15-917c-f33839b1c393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:31.491231 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 600/1202] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Jul 25 22:59:31 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:31.503876 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f4702-d341-4ab0-9498-9675c8502c87 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:31.515244 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f4702-d341-4ab0-9498-9675c8502c87 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:31.518953 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5a48b-3c8a-43ee-a85e-8243f3f61d02 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a0fb71700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:31.519565 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5a48b-3c8a-43ee-a85e-8243f3f61d02 service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:31.519851 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5a48b-3c8a-43ee-a85e-8243f3f61d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:31.520127 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5a48b-3c8a-43ee-a85e-8243f3f61d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:31.528242 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5a48b-3c8a-43ee-a85e-8243f3f61d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:31.529634 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5a48b-3c8a-43ee-a85e-8243f3f61d02 service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:31.540034 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 603/1203] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:31 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:31.954280 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc9b70-49d3-4bda-aec6-8769312c90cb None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:31.954845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc9b70-49d3-4bda-aec6-8769312c90cb None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:31.954845 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc9b70-49d3-4bda-aec6-8769312c90cb None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:31.956160 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 601/1204] 10.222.0.47 () {54 vars in 962 bytes} [Mon Jul 25 22:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:59:31.964015 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b602769-7aeb-4ff3-b105-196d61123b68 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:31.964426 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b602769-7aeb-4ff3-b105-196d61123b68 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:31.964846 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b602769-7aeb-4ff3-b105-196d61123b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:31.984017 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002409d7-a22b-496a-bff8-2a08c3dee197 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:31.984498 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002409d7-a22b-496a-bff8-2a08c3dee197 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:31.985020 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002409d7-a22b-496a-bff8-2a08c3dee197 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:31.987761 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 602/1205] 10.222.0.47 () {54 vars in 961 bytes} [Mon Jul 25 22:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:59:31.988929 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-0b602769-7aeb-4ff3-b105-196d61123b68 None None] MFA Rules not processed for user `a2528d7506a5481f8fa6bb5012b4a9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:31.990948 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-0b602769-7aeb-4ff3-b105-196d61123b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:31.995944 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9270d2-51dd-4fbd-b50d-c494fb0a8ed3 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:31.996310 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9270d2-51dd-4fbd-b50d-c494fb0a8ed3 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:31.996668 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9270d2-51dd-4fbd-b50d-c494fb0a8ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:32.001112 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 604/1206] 10.222.0.47 () {58 vars in 1059 bytes} [Mon Jul 25 22:59:31 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:32.007090 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46c25-9659-4d4b-844a-0549ff41595d None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:32.007404 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46c25-9659-4d4b-844a-0549ff41595d None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:32.007663 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46c25-9659-4d4b-844a-0549ff41595d None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:32.009618 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 605/1207] 10.222.0.47 () {54 vars in 912 bytes} [Mon Jul 25 22:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:59:32.015047 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7899d-6c4d-4f85-8d19-1c8a02ea4067 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:32.016819 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7899d-6c4d-4f85-8d19-1c8a02ea4067 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:32.017445 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7899d-6c4d-4f85-8d19-1c8a02ea4067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:32.032932 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-8f9270d2-51dd-4fbd-b50d-c494fb0a8ed3 None None] MFA Rules not processed for user `530c96407340435c982fd99367689007`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:32.034577 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-8f9270d2-51dd-4fbd-b50d-c494fb0a8ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:32.041782 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-f0e7899d-6c4d-4f85-8d19-1c8a02ea4067 None None] MFA Rules not processed for user `a2528d7506a5481f8fa6bb5012b4a9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:32.043213 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-f0e7899d-6c4d-4f85-8d19-1c8a02ea4067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:32.055195 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 606/1208] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Jul 25 22:59:32 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:32.075376 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7899d-6c4d-4f85-8d19-1c8a02ea4067 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:32.090225 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7899d-6c4d-4f85-8d19-1c8a02ea4067 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:32.098255 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164e9a7-ab57-4691-97ae-1a37abfa036d service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fb29a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:32.100713 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164e9a7-ab57-4691-97ae-1a37abfa036d service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:32.101524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164e9a7-ab57-4691-97ae-1a37abfa036d service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:32.102091 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164e9a7-ab57-4691-97ae-1a37abfa036d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:32.118754 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164e9a7-ab57-4691-97ae-1a37abfa036d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:32.118994 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=100 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:32.121647 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164e9a7-ab57-4691-97ae-1a37abfa036d service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:32.134315 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 603/1209] 10.222.0.47 () {58 vars in 1058 bytes} [Mon Jul 25 22:59:31 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:32.140842 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 607/1210] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:32 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:32.142818 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9270d2-51dd-4fbd-b50d-c494fb0a8ed3 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:32.155403 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9270d2-51dd-4fbd-b50d-c494fb0a8ed3 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:32.162809 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e4708-e159-412c-888c-312ee01f1a8f service placement] RBAC: auth_context: {'token': <TokenModel (audit_id=1Nvp4Js6Se-duvnWexuFnA, audit_chain_id=['1Nvp4Js6Se-duvnWexuFnA']) at 0x7f8a14284eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530c96407340435c982fd99367689007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:32.163438 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e4708-e159-412c-888c-312ee01f1a8f service placement] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:32.163720 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e4708-e159-412c-888c-312ee01f1a8f service placement] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:32.164332 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e4708-e159-412c-888c-312ee01f1a8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:32.166346 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-c47e4708-e159-412c-888c-312ee01f1a8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:32.179795 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e4708-e159-412c-888c-312ee01f1a8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:32.182187 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e4708-e159-412c-888c-312ee01f1a8f service placement] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:32.194929 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 604/1211] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:32 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:59:42.131152 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=79 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:42.190139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=7 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:44.990871 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb1f09-e485-443c-8199-e223a718671d None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:44.991476 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb1f09-e485-443c-8199-e223a718671d None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:44.991476 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb1f09-e485-443c-8199-e223a718671d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:45.011460 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-bbfb1f09-e485-443c-8199-e223a718671d None None] MFA Rules not processed for user `f77ef50984084af9bcd220fc68deacf8`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:45.012658 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-bbfb1f09-e485-443c-8199-e223a718671d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:45.019103 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 608/1212] 10.222.0.52 () {58 vars in 1015 bytes} [Mon Jul 25 22:59:44 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:45.031819 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e4708-e159-412c-888c-312ee01f1a8f service placement] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:45.042854 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e4708-e159-412c-888c-312ee01f1a8f service placement] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:45.046642 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a787dff-3ce6-47dc-ad6e-4fe0ae1e8952 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a14361130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:45.047265 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a787dff-3ce6-47dc-ad6e-4fe0ae1e8952 service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:45.047552 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a787dff-3ce6-47dc-ad6e-4fe0ae1e8952 service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:45.047828 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a787dff-3ce6-47dc-ad6e-4fe0ae1e8952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:45.056141 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a787dff-3ce6-47dc-ad6e-4fe0ae1e8952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:45.057564 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a787dff-3ce6-47dc-ad6e-4fe0ae1e8952 service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:45.066093 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 605/1213] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:45 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:45.847996 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35209b63-ded3-4e53-9730-9d9d4ac19e5a None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:45.848356 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35209b63-ded3-4e53-9730-9d9d4ac19e5a None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:45.849357 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35209b63-ded3-4e53-9730-9d9d4ac19e5a None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:45.851072 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 609/1214] 10.222.0.47 () {54 vars in 921 bytes} [Mon Jul 25 22:59:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:59:45.859823 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a242f8b-6daf-408d-9016-2d24c201bc00 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:45.860175 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a242f8b-6daf-408d-9016-2d24c201bc00 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:45.860392 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a242f8b-6daf-408d-9016-2d24c201bc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:45.893341 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-1a242f8b-6daf-408d-9016-2d24c201bc00 None None] MFA Rules not processed for user `a2528d7506a5481f8fa6bb5012b4a9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:45.894616 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-1a242f8b-6daf-408d-9016-2d24c201bc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:45.908912 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 606/1215] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Jul 25 22:59:45 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:45.924029 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35209b63-ded3-4e53-9730-9d9d4ac19e5a None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:45.939977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35209b63-ded3-4e53-9730-9d9d4ac19e5a None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:45.945561 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f5fa6-660a-495c-b049-5d42162248b5 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=fePsJ4wlS7a7iu841aoi_g, audit_chain_id=['fePsJ4wlS7a7iu841aoi_g']) at 0x7f8a0fb01670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:45.946235 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f5fa6-660a-495c-b049-5d42162248b5 service nova] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:45.946521 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f5fa6-660a-495c-b049-5d42162248b5 service nova] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:45.946799 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f5fa6-660a-495c-b049-5d42162248b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:45.956023 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f5fa6-660a-495c-b049-5d42162248b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:45.957656 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f5fa6-660a-495c-b049-5d42162248b5 service nova] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:45.971047 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 610/1216] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:45 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:54.410654 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51709c-fae5-4336-a150-7c9868bb3f54 None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:54.411303 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51709c-fae5-4336-a150-7c9868bb3f54 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:54.411303 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51709c-fae5-4336-a150-7c9868bb3f54 None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:54.413092 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 607/1217] 10.222.0.47 () {54 vars in 921 bytes} [Mon Jul 25 22:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:59:54.424697 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac385ae-087f-469a-a2de-e12f909af213 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:54.425227 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac385ae-087f-469a-a2de-e12f909af213 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:54.425710 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac385ae-087f-469a-a2de-e12f909af213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:54.451119 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-7ac385ae-087f-469a-a2de-e12f909af213 None None] MFA Rules not processed for user `a2528d7506a5481f8fa6bb5012b4a9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:54.452342 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-7ac385ae-087f-469a-a2de-e12f909af213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:54.461863 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 611/1218] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Jul 25 22:59:54 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:54.477530 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51709c-fae5-4336-a150-7c9868bb3f54 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:54.494375 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51709c-fae5-4336-a150-7c9868bb3f54 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:54.500115 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3e93a-a3b7-4834-afe0-67c02b8e480f service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=fePsJ4wlS7a7iu841aoi_g, audit_chain_id=['fePsJ4wlS7a7iu841aoi_g']) at 0x7f8a0fcd5f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:54.500740 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3e93a-a3b7-4834-afe0-67c02b8e480f service nova] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:54.501053 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3e93a-a3b7-4834-afe0-67c02b8e480f service nova] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:54.501343 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3e93a-a3b7-4834-afe0-67c02b8e480f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:54.511672 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3e93a-a3b7-4834-afe0-67c02b8e480f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:54.513252 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3e93a-a3b7-4834-afe0-67c02b8e480f service nova] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:54.523395 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 608/1219] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:54 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:04.445834 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=12 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:04.518784 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=15 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:07.088740 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac385ae-087f-469a-a2de-e12f909af213 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:07.098059 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac385ae-087f-469a-a2de-e12f909af213 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:07.102538 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a58fc2-66f0-4dbf-a2d6-50f359524fbb service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fbc46d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:07.103154 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a58fc2-66f0-4dbf-a2d6-50f359524fbb service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:07.103466 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a58fc2-66f0-4dbf-a2d6-50f359524fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:07.103745 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a58fc2-66f0-4dbf-a2d6-50f359524fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:07.112654 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a58fc2-66f0-4dbf-a2d6-50f359524fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:07.114124 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a58fc2-66f0-4dbf-a2d6-50f359524fbb service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:07.124407 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 612/1220] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:07 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:17.120347 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=6 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:19.786751 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daf95f-b27f-4029-8a80-054be808a826 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:19.787417 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daf95f-b27f-4029-8a80-054be808a826 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:19.787417 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68daf95f-b27f-4029-8a80-054be808a826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:19.809515 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-68daf95f-b27f-4029-8a80-054be808a826 None None] MFA Rules not processed for user `51baecd04d6d4edd803afa43e8f7f1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:19.810735 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-68daf95f-b27f-4029-8a80-054be808a826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:19.818055 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 609/1221] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 23:00:19 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:29.804581 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=3 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:46.169020 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97965138-cdc1-4804-b14d-1980980c2b3c None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:46.169478 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97965138-cdc1-4804-b14d-1980980c2b3c None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:46.169635 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97965138-cdc1-4804-b14d-1980980c2b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:46.188588 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-97965138-cdc1-4804-b14d-1980980c2b3c None None] MFA Rules not processed for user `51baecd04d6d4edd803afa43e8f7f1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:00:46.189833 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-97965138-cdc1-4804-b14d-1980980c2b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:46.196696 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 613/1222] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 23:00:46 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:00:56.183293 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=3 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:01.813249 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4449f-e880-4565-9cb2-c7a286052c29 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:01.813755 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4449f-e880-4565-9cb2-c7a286052c29 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:01.813848 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4449f-e880-4565-9cb2-c7a286052c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:01.832975 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-10d4449f-e880-4565-9cb2-c7a286052c29 None None] MFA Rules not processed for user `51baecd04d6d4edd803afa43e8f7f1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:01.834206 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-10d4449f-e880-4565-9cb2-c7a286052c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:01.841684 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 610/1223] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 23:01:01 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:01:11.827816 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=3 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:59.283409 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4f15d-776e-4257-83f1-a59fac65fb59 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:59.283897 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4f15d-776e-4257-83f1-a59fac65fb59 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:59.283991 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4f15d-776e-4257-83f1-a59fac65fb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:59.302545 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-a4a4f15d-776e-4257-83f1-a59fac65fb59 None None] MFA Rules not processed for user `51baecd04d6d4edd803afa43e8f7f1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:01:59.304328 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-a4a4f15d-776e-4257-83f1-a59fac65fb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:59.311010 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 614/1224] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 23:01:59 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:02:09.297494 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=3 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:12.013518 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4449f-e880-4565-9cb2-c7a286052c29 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:02:12.033078 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4449f-e880-4565-9cb2-c7a286052c29 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:02:12.036626 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39865cc-c1cc-4340-b447-d7cff72e747a service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fa1a310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:02:12.037234 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39865cc-c1cc-4340-b447-d7cff72e747a service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:02:12.037513 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39865cc-c1cc-4340-b447-d7cff72e747a service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:02:12.038436 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39865cc-c1cc-4340-b447-d7cff72e747a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:02:12.047723 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39865cc-c1cc-4340-b447-d7cff72e747a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:02:12.049144 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39865cc-c1cc-4340-b447-d7cff72e747a service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:02:12.059693 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 611/1225] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 23:02:12 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:02:22.055538 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=10 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:26.546695 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4f15d-776e-4257-83f1-a59fac65fb59 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:03:26.567210 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4f15d-776e-4257-83f1-a59fac65fb59 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:03:26.572181 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9de8b9-9812-4935-96b3-22f3883f007f service placement] RBAC: auth_context: {'token': <TokenModel (audit_id=1Nvp4Js6Se-duvnWexuFnA, audit_chain_id=['1Nvp4Js6Se-duvnWexuFnA']) at 0x7f8a0fb10640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530c96407340435c982fd99367689007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:03:26.573304 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9de8b9-9812-4935-96b3-22f3883f007f service placement] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:03:26.573598 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9de8b9-9812-4935-96b3-22f3883f007f service placement] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:03:26.573886 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9de8b9-9812-4935-96b3-22f3883f007f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:03:26.582169 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9de8b9-9812-4935-96b3-22f3883f007f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:03:26.583728 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9de8b9-9812-4935-96b3-22f3883f007f service placement] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:03:26.593970 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 615/1226] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 23:03:26 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:03:36.589962 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=10 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:21.215496 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39865cc-c1cc-4340-b447-d7cff72e747a service neutron] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:21.237159 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39865cc-c1cc-4340-b447-d7cff72e747a service neutron] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:21.242114 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d613f-e186-436c-81cb-32a1525f27c6 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=fePsJ4wlS7a7iu841aoi_g, audit_chain_id=['fePsJ4wlS7a7iu841aoi_g']) at 0x7f8a0f921eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:21.242727 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d613f-e186-436c-81cb-32a1525f27c6 service nova] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:21.243104 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d613f-e186-436c-81cb-32a1525f27c6 service nova] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:21.243411 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d613f-e186-436c-81cb-32a1525f27c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:21.251343 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d613f-e186-436c-81cb-32a1525f27c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:21.252911 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d613f-e186-436c-81cb-32a1525f27c6 service nova] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:21.271420 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 612/1227] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:21 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:23.708756 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475f1fd-ba0d-42c3-9dc3-7a6e075d71bc None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:23.709216 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475f1fd-ba0d-42c3-9dc3-7a6e075d71bc None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:23.709306 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475f1fd-ba0d-42c3-9dc3-7a6e075d71bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:23.728949 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-8475f1fd-ba0d-42c3-9dc3-7a6e075d71bc None None] MFA Rules not processed for user `51baecd04d6d4edd803afa43e8f7f1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:23.730216 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-8475f1fd-ba0d-42c3-9dc3-7a6e075d71bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:23.736852 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 616/1228] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 23:04:23 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:24.093777 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28f17c-13c5-4ae5-b4ae-4f8b66498516 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:24.094323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28f17c-13c5-4ae5-b4ae-4f8b66498516 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:24.094323 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28f17c-13c5-4ae5-b4ae-4f8b66498516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:24.147754 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-ab28f17c-13c5-4ae5-b4ae-4f8b66498516 None None] MFA Rules not processed for user `f77ef50984084af9bcd220fc68deacf8`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:24.148974 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-ab28f17c-13c5-4ae5-b4ae-4f8b66498516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:24.155985 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 613/1229] 10.222.0.47 () {58 vars in 1009 bytes} [Mon Jul 25 23:04:24 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:04:24.167681 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475f1fd-ba0d-42c3-9dc3-7a6e075d71bc None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:24.176851 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475f1fd-ba0d-42c3-9dc3-7a6e075d71bc None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:24.180374 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef42797-56fc-4d41-8351-2f45e0b08ac2 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fbc1d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:24.180981 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef42797-56fc-4d41-8351-2f45e0b08ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:24.181866 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef42797-56fc-4d41-8351-2f45e0b08ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:24.182194 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef42797-56fc-4d41-8351-2f45e0b08ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:24.189063 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef42797-56fc-4d41-8351-2f45e0b08ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:24.190524 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef42797-56fc-4d41-8351-2f45e0b08ac2 service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:24.199012 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 617/1230] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:24 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:31.616628 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28f17c-13c5-4ae5-b4ae-4f8b66498516 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:31.625769 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28f17c-13c5-4ae5-b4ae-4f8b66498516 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:31.629329 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0450f-cf32-4d82-84de-0828b90b3200 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a0f921a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:31.629965 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0450f-cf32-4d82-84de-0828b90b3200 service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:31.630284 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0450f-cf32-4d82-84de-0828b90b3200 service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:31.630557 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0450f-cf32-4d82-84de-0828b90b3200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:31.640456 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0450f-cf32-4d82-84de-0828b90b3200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:31.641904 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0450f-cf32-4d82-84de-0828b90b3200 service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:31.652435 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 614/1231] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:31 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:32.829610 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef42797-56fc-4d41-8351-2f45e0b08ac2 service neutron] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:32.838286 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef42797-56fc-4d41-8351-2f45e0b08ac2 service neutron] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:32.842046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9220d0d-a5a0-4b43-bfdf-f4cea5350591 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fba4af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:32.842698 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9220d0d-a5a0-4b43-bfdf-f4cea5350591 service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:32.842976 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9220d0d-a5a0-4b43-bfdf-f4cea5350591 service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:32.843246 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9220d0d-a5a0-4b43-bfdf-f4cea5350591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:32.853414 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9220d0d-a5a0-4b43-bfdf-f4cea5350591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:32.855692 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9220d0d-a5a0-4b43-bfdf-f4cea5350591 service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:32.867111 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 618/1232] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:32 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 23:04:38.791130 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d694d-54e5-45c9-ab5d-95464df4ea2f None None] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:38.791688 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d694d-54e5-45c9-ab5d-95464df4ea2f None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:38.791688 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d694d-54e5-45c9-ab5d-95464df4ea2f None None] PATH_INFO: `/` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:38.793055 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 615/1233] 10.222.0.47 () {54 vars in 921 bytes} [Mon Jul 25 23:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:04:38.798170 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effa84e-d22f-4b34-b204-87363b3f00e2 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:38.798637 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effa84e-d22f-4b34-b204-87363b3f00e2 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:38.798734 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effa84e-d22f-4b34-b204-87363b3f00e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:38.835959 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-1effa84e-d22f-4b34-b204-87363b3f00e2 None None] MFA Rules not processed for user `a2528d7506a5481f8fa6bb5012b4a9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:04:38.837238 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-1effa84e-d22f-4b34-b204-87363b3f00e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:04:38.846422 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 619/1234] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Jul 25 23:04:38 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:04:38.858386 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d694d-54e5-45c9-ab5d-95464df4ea2f None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:38.871809 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d694d-54e5-45c9-ab5d-95464df4ea2f None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:38.876758 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4950a13-c952-499b-ba2a-d693b48ff837 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=fePsJ4wlS7a7iu841aoi_g, audit_chain_id=['fePsJ4wlS7a7iu841aoi_g']) at 0x7f8a0ff06fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:38.877371 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4950a13-c952-499b-ba2a-d693b48ff837 service nova] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:38.877687 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4950a13-c952-499b-ba2a-d693b48ff837 service nova] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:38.877971 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4950a13-c952-499b-ba2a-d693b48ff837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:38.886799 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4950a13-c952-499b-ba2a-d693b48ff837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:38.889200 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4950a13-c952-499b-ba2a-d693b48ff837 service nova] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:38.898902 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 616/1235] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:38 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:48.833547 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=24 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:48.894950 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=35 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:54.804990 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effa84e-d22f-4b34-b204-87363b3f00e2 None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:54.816770 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effa84e-d22f-4b34-b204-87363b3f00e2 None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:54.821779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dbdea-9f88-4c46-a5e6-35da7b325051 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=ivdcD7pqTtOJwJPP1hFCvw, audit_chain_id=['ivdcD7pqTtOJwJPP1hFCvw']) at 0x7f8a140ccd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:54.822397 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dbdea-9f88-4c46-a5e6-35da7b325051 service nova] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:54.822683 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dbdea-9f88-4c46-a5e6-35da7b325051 service nova] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:54.822958 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dbdea-9f88-4c46-a5e6-35da7b325051 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:54.830768 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2dbdea-9f88-4c46-a5e6-35da7b325051 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:54.832378 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2dbdea-9f88-4c46-a5e6-35da7b325051 service nova] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:54.841074 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 620/1236] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:54 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:04:55.535981 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4950a13-c952-499b-ba2a-d693b48ff837 service nova] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:04:55.548061 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4950a13-c952-499b-ba2a-d693b48ff837 service nova] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:04:55.552425 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb7f78-580e-4d0b-a5f8-2594bc448880 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fc51ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:04:55.553499 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb7f78-580e-4d0b-a5f8-2594bc448880 service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:04:55.553897 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb7f78-580e-4d0b-a5f8-2594bc448880 service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:04:55.554244 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb7f78-580e-4d0b-a5f8-2594bc448880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:04:55.562565 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb7f78-580e-4d0b-a5f8-2594bc448880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:04:55.564032 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb7f78-580e-4d0b-a5f8-2594bc448880 service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:04:55.574357 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 617/1237] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 23:04:55 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:01.357958 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dbdea-9f88-4c46-a5e6-35da7b325051 service nova] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:01.371665 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dbdea-9f88-4c46-a5e6-35da7b325051 service nova] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:01.376843 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8bcd5-21d4-4cf2-bb5c-a7faa20b786f service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=ivdcD7pqTtOJwJPP1hFCvw, audit_chain_id=['ivdcD7pqTtOJwJPP1hFCvw']) at 0x7f8a140bae80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:01.377473 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8bcd5-21d4-4cf2-bb5c-a7faa20b786f service nova] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:01.377789 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8bcd5-21d4-4cf2-bb5c-a7faa20b786f service nova] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:01.378071 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8bcd5-21d4-4cf2-bb5c-a7faa20b786f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:01.390572 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8bcd5-21d4-4cf2-bb5c-a7faa20b786f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:01.392567 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8bcd5-21d4-4cf2-bb5c-a7faa20b786f service nova] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:01.406604 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 621/1238] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:01 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:05.570001 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=6 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:09.607792 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668a663-63c7-41ae-a617-199b9d8ba642 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:09.608403 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668a663-63c7-41ae-a617-199b9d8ba642 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:09.608403 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668a663-63c7-41ae-a617-199b9d8ba642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:09.627268 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-0668a663-63c7-41ae-a617-199b9d8ba642 None None] MFA Rules not processed for user `c03cf4f5f0eb46f39f2fd3c55c9f4857`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:05:09.628473 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-0668a663-63c7-41ae-a617-199b9d8ba642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:09.635974 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 618/1239] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 23:05:09 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:05:09.887370 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8bcd5-21d4-4cf2-bb5c-a7faa20b786f service nova] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:09.896326 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8bcd5-21d4-4cf2-bb5c-a7faa20b786f service nova] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:09.899941 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d6cf8-1aa7-43b3-a753-1f2e0a6fd3f9 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a14123cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:09.900551 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d6cf8-1aa7-43b3-a753-1f2e0a6fd3f9 service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:09.900834 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d6cf8-1aa7-43b3-a753-1f2e0a6fd3f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:09.901112 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d6cf8-1aa7-43b3-a753-1f2e0a6fd3f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:09.908118 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d6cf8-1aa7-43b3-a753-1f2e0a6fd3f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:09.909545 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d6cf8-1aa7-43b3-a753-1f2e0a6fd3f9 service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:09.917242 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 622/1240] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:09 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:10.226139 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668a663-63c7-41ae-a617-199b9d8ba642 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:10.237880 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668a663-63c7-41ae-a617-199b9d8ba642 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:10.242707 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0599b97-374b-45af-aa6d-e3d0ae973243 service placement] RBAC: auth_context: {'token': <TokenModel (audit_id=1Nvp4Js6Se-duvnWexuFnA, audit_chain_id=['1Nvp4Js6Se-duvnWexuFnA']) at 0x7f8a0f974820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530c96407340435c982fd99367689007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:10.243321 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0599b97-374b-45af-aa6d-e3d0ae973243 service placement] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:10.243602 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0599b97-374b-45af-aa6d-e3d0ae973243 service placement] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:10.243875 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0599b97-374b-45af-aa6d-e3d0ae973243 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:10.253037 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0599b97-374b-45af-aa6d-e3d0ae973243 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:10.254671 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0599b97-374b-45af-aa6d-e3d0ae973243 service placement] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:10.265986 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 619/1241] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:10 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:19.913973 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=18 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:20.261042 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=9 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:30.105679 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d6cf8-1aa7-43b3-a753-1f2e0a6fd3f9 service neutron] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:30.118934 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d6cf8-1aa7-43b3-a753-1f2e0a6fd3f9 service neutron] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:30.125439 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e924b-3632-4744-8e14-25106bea60c6 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=fePsJ4wlS7a7iu841aoi_g, audit_chain_id=['fePsJ4wlS7a7iu841aoi_g']) at 0x7f8a141230a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2528d7506a5481f8fa6bb5012b4a9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:30.126098 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e924b-3632-4744-8e14-25106bea60c6 service nova] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:30.126383 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e924b-3632-4744-8e14-25106bea60c6 service nova] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:30.126660 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e924b-3632-4744-8e14-25106bea60c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:30.136446 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e924b-3632-4744-8e14-25106bea60c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:30.138438 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e924b-3632-4744-8e14-25106bea60c6 service nova] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:30.148989 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 623/1242] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:30 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:38.468101 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0599b97-374b-45af-aa6d-e3d0ae973243 service placement] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:38.478136 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0599b97-374b-45af-aa6d-e3d0ae973243 service placement] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:38.481642 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24103c48-1ff6-4746-a181-aeb3ae3c2d72 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=jURwyzS7Tp2pwBwfJoi9qA, audit_chain_id=['jURwyzS7Tp2pwBwfJoi9qA']) at 0x7f8a0fa1a670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:38.482281 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24103c48-1ff6-4746-a181-aeb3ae3c2d72 service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:38.482564 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24103c48-1ff6-4746-a181-aeb3ae3c2d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:38.482837 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24103c48-1ff6-4746-a181-aeb3ae3c2d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:38.492374 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24103c48-1ff6-4746-a181-aeb3ae3c2d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:38.493814 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24103c48-1ff6-4746-a181-aeb3ae3c2d72 service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:38.502931 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 620/1243] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:38 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:40.144310 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=6 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:48.498910 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=6 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:17.447831 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f2121-d951-4a3d-af5c-07b21c46d9f8 None None] REQUEST_METHOD: `POST` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:06:17.448357 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f2121-d951-4a3d-af5c-07b21c46d9f8 None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:06:17.448357 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f2121-d951-4a3d-af5c-07b21c46d9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:06:17.467536 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.auth.core [None req-2e1f2121-d951-4a3d-af5c-07b21c46d9f8 None None] MFA Rules not processed for user `51baecd04d6d4edd803afa43e8f7f1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=93656) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:06:17.468740 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-2e1f2121-d951-4a3d-af5c-07b21c46d9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:06:17.475623 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 624/1244] 10.222.0.47 () {58 vars in 958 bytes} [Mon Jul 25 23:06:17 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 23:06:27.463368 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=3 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:22.330238 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24103c48-1ff6-4746-a181-aeb3ae3c2d72 service neutron] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:22.350777 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24103c48-1ff6-4746-a181-aeb3ae3c2d72 service neutron] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:22.354926 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bfa21-8b42-4627-97fa-90ca470a705b service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fcd5640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:22.355533 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bfa21-8b42-4627-97fa-90ca470a705b service neutron] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:22.355817 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bfa21-8b42-4627-97fa-90ca470a705b service neutron] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:22.356095 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bfa21-8b42-4627-97fa-90ca470a705b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:22.447686 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bfa21-8b42-4627-97fa-90ca470a705b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:22.449029 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bfa21-8b42-4627-97fa-90ca470a705b service neutron] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:22.468159 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 621/1245] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 23:08:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:08:25.717384 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfe032-23f3-409a-8355-ef971ed813fb None None] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:25.718011 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfe032-23f3-409a-8355-ef971ed813fb None None] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:25.718126 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfe032-23f3-409a-8355-ef971ed813fb None None] PATH_INFO: `/` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:25.720101 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 625/1246] 10.222.0.47 () {54 vars in 921 bytes} [Mon Jul 25 23:08:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 23:08:25.730754 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c77a3-a999-4d96-9846-60db34bf4f70 None None] REQUEST_METHOD: `POST` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:25.731252 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c77a3-a999-4d96-9846-60db34bf4f70 None None] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:25.731483 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c77a3-a999-4d96-9846-60db34bf4f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:25.810399 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.auth.core [None req-a11c77a3-a999-4d96-9846-60db34bf4f70 None None] MFA Rules not processed for user `530c96407340435c982fd99367689007`. Rule list: `[]` (Enabled: `True`). {{(pid=93655) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 23:08:25.811665 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-a11c77a3-a999-4d96-9846-60db34bf4f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:25.830793 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 622/1247] 10.222.0.47 () {58 vars in 1018 bytes} [Mon Jul 25 23:08:25 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 23:08:25.842889 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfe032-23f3-409a-8355-ef971ed813fb None None] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:25.844883 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-d7cfe032-23f3-409a-8355-ef971ed813fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:25.861248 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfe032-23f3-409a-8355-ef971ed813fb None None] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:25.866258 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b4f5a-0c28-4589-906f-0ff50d21dbb3 service placement] RBAC: auth_context: {'token': <TokenModel (audit_id=uDdW4jsyRDiewx6tJs9J5g, audit_chain_id=['uDdW4jsyRDiewx6tJs9J5g']) at 0x7f8a0fbafb20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530c96407340435c982fd99367689007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:25.866881 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b4f5a-0c28-4589-906f-0ff50d21dbb3 service placement] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:25.867164 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b4f5a-0c28-4589-906f-0ff50d21dbb3 service placement] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:25.867439 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b4f5a-0c28-4589-906f-0ff50d21dbb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:25.876493 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b4f5a-0c28-4589-906f-0ff50d21dbb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:25.878119 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b4f5a-0c28-4589-906f-0ff50d21dbb3 service placement] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:25.888744 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 626/1248] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 23:08:25 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:08:28.951922 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c77a3-a999-4d96-9846-60db34bf4f70 None None] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:28.962741 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c77a3-a999-4d96-9846-60db34bf4f70 None None] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:28.967397 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1daf48-3780-4f35-9257-01bdc6aea29b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v0R5rqPCQJ6JVXxopDE-sw, audit_chain_id=['v0R5rqPCQJ6JVXxopDE-sw']) at 0x7f8a0fa1aca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:28.968134 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1daf48-3780-4f35-9257-01bdc6aea29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:28.968492 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1daf48-3780-4f35-9257-01bdc6aea29b admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:28.968858 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1daf48-3780-4f35-9257-01bdc6aea29b admin admin] PATH_INFO: `/v3/users/c03cf4f5f0eb46f39f2fd3c55c9f4857` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:28.974176 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1daf48-3780-4f35-9257-01bdc6aea29b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c03cf4f5f0eb46f39f2fd3c55c9f4857)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:28.976273 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1daf48-3780-4f35-9257-01bdc6aea29b admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:29.028205 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:29.031530 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-5e1daf48-3780-4f35-9257-01bdc6aea29b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c03cf4f5f0eb46f39f2fd3c55c9f4857'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:29.039649 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-5e1daf48-3780-4f35-9257-01bdc6aea29b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c03cf4f5f0eb46f39f2fd3c55c9f4857'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:29.040443 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-5e1daf48-3780-4f35-9257-01bdc6aea29b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c03cf4f5f0eb46f39f2fd3c55c9f4857'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:29.041210 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-5e1daf48-3780-4f35-9257-01bdc6aea29b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c03cf4f5f0eb46f39f2fd3c55c9f4857'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:29.053730 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-5e1daf48-3780-4f35-9257-01bdc6aea29b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c03cf4f5f0eb46f39f2fd3c55c9f4857'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:29.069159 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 623/1249] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Jul 25 23:08:28 2022] DELETE /identity/v3/users/c03cf4f5f0eb46f39f2fd3c55c9f4857 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:08:29.261601 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b4f5a-0c28-4589-906f-0ff50d21dbb3 service placement] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:29.272338 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b4f5a-0c28-4589-906f-0ff50d21dbb3 service placement] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:29.329324 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f1bde-3468-422d-a37f-6846547f3377 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v0R5rqPCQJ6JVXxopDE-sw, audit_chain_id=['v0R5rqPCQJ6JVXxopDE-sw']) at 0x7f8a141230a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:29.329974 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f1bde-3468-422d-a37f-6846547f3377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:29.330258 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f1bde-3468-422d-a37f-6846547f3377 admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:29.330534 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f1bde-3468-422d-a37f-6846547f3377 admin admin] PATH_INFO: `/v3/projects/9b24bf80d32a4e9a8133d13422f731c5` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:29.331694 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f1bde-3468-422d-a37f-6846547f3377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b24bf80d32a4e9a8133d13422f731c5)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:29.333757 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f1bde-3468-422d-a37f-6846547f3377 admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:29.379545 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-ad6f1bde-3468-422d-a37f-6846547f3377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b24bf80d32a4e9a8133d13422f731c5', 'request_id': 'req-ad6f1bde-3468-422d-a37f-6846547f3377'} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:29.387535 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-ad6f1bde-3468-422d-a37f-6846547f3377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b24bf80d32a4e9a8133d13422f731c5', 'request_id': 'req-ad6f1bde-3468-422d-a37f-6846547f3377'} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:29.393061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-ad6f1bde-3468-422d-a37f-6846547f3377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b24bf80d32a4e9a8133d13422f731c5', 'request_id': 'req-ad6f1bde-3468-422d-a37f-6846547f3377'} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:29.418295 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-ad6f1bde-3468-422d-a37f-6846547f3377 admin admin] The token cache is being invalidate because project 9b24bf80d32a4e9a8133d13422f731c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:08:29.418584 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-ad6f1bde-3468-422d-a37f-6846547f3377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:29.419232 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-ad6f1bde-3468-422d-a37f-6846547f3377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:29.420733 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 627/1250] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Jul 25 23:08:29 2022] DELETE /identity/v3/projects/9b24bf80d32a4e9a8133d13422f731c5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:08:29.424737 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1daf48-3780-4f35-9257-01bdc6aea29b admin admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:29.426163 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-5e1daf48-3780-4f35-9257-01bdc6aea29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:29.439947 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1daf48-3780-4f35-9257-01bdc6aea29b admin admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:29.503140 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d321ff-626b-4bcd-917c-2777a45943f4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v0R5rqPCQJ6JVXxopDE-sw, audit_chain_id=['v0R5rqPCQJ6JVXxopDE-sw']) at 0x7f8a140889a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:29.503786 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d321ff-626b-4bcd-917c-2777a45943f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:29.504067 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d321ff-626b-4bcd-917c-2777a45943f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:29.504344 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d321ff-626b-4bcd-917c-2777a45943f4 admin admin] PATH_INFO: `/v3/users/1c4034e95f404cfd814cc2ba03158de2` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:29.505482 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d321ff-626b-4bcd-917c-2777a45943f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4034e95f404cfd814cc2ba03158de2)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:29.507436 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d321ff-626b-4bcd-917c-2777a45943f4 admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:29.553221 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-51d321ff-626b-4bcd-917c-2777a45943f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4034e95f404cfd814cc2ba03158de2'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:29.560815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-51d321ff-626b-4bcd-917c-2777a45943f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4034e95f404cfd814cc2ba03158de2'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:29.561467 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-51d321ff-626b-4bcd-917c-2777a45943f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4034e95f404cfd814cc2ba03158de2'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:29.562111 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-51d321ff-626b-4bcd-917c-2777a45943f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4034e95f404cfd814cc2ba03158de2'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:29.574541 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-51d321ff-626b-4bcd-917c-2777a45943f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4034e95f404cfd814cc2ba03158de2'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:29.586717 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 624/1251] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Jul 25 23:08:29 2022] DELETE /identity/v3/users/1c4034e95f404cfd814cc2ba03158de2 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:08:29.759242 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f1bde-3468-422d-a37f-6846547f3377 admin admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:29.761303 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-ad6f1bde-3468-422d-a37f-6846547f3377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:29.776457 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f1bde-3468-422d-a37f-6846547f3377 admin admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:29.839494 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2041cb-eff5-4dc0-b7d1-099fc171485a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=v0R5rqPCQJ6JVXxopDE-sw, audit_chain_id=['v0R5rqPCQJ6JVXxopDE-sw']) at 0x7f8a140bae80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:29.840148 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2041cb-eff5-4dc0-b7d1-099fc171485a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:29.840431 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2041cb-eff5-4dc0-b7d1-099fc171485a admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:29.840705 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2041cb-eff5-4dc0-b7d1-099fc171485a admin admin] PATH_INFO: `/v3/projects/97b05b7c37c54401820b12e4240c6de8` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:29.841900 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2041cb-eff5-4dc0-b7d1-099fc171485a admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b05b7c37c54401820b12e4240c6de8)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:29.843807 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2041cb-eff5-4dc0-b7d1-099fc171485a admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:29.851654 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:29.891061 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-9d2041cb-eff5-4dc0-b7d1-099fc171485a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b05b7c37c54401820b12e4240c6de8', 'request_id': 'req-9d2041cb-eff5-4dc0-b7d1-099fc171485a'} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:29.898999 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-9d2041cb-eff5-4dc0-b7d1-099fc171485a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b05b7c37c54401820b12e4240c6de8', 'request_id': 'req-9d2041cb-eff5-4dc0-b7d1-099fc171485a'} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:29.904775 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-9d2041cb-eff5-4dc0-b7d1-099fc171485a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b05b7c37c54401820b12e4240c6de8', 'request_id': 'req-9d2041cb-eff5-4dc0-b7d1-099fc171485a'} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:29.915898 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-9d2041cb-eff5-4dc0-b7d1-099fc171485a admin admin] The token cache is being invalidate because project 97b05b7c37c54401820b12e4240c6de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:08:29.916189 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-9d2041cb-eff5-4dc0-b7d1-099fc171485a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:29.916817 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-9d2041cb-eff5-4dc0-b7d1-099fc171485a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:08:29.918339 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 628/1252] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Jul 25 23:08:29 2022] DELETE /identity/v3/projects/97b05b7c37c54401820b12e4240c6de8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:08:31.624858 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d321ff-626b-4bcd-917c-2777a45943f4 admin admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:31.626345 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-51d321ff-626b-4bcd-917c-2777a45943f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:31.670884 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:31.698639 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d321ff-626b-4bcd-917c-2777a45943f4 admin admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:31.757470 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb74bc-a24c-464a-982b-41370663c851 service placement] RBAC: auth_context: {'token': <TokenModel (audit_id=uDdW4jsyRDiewx6tJs9J5g, audit_chain_id=['uDdW4jsyRDiewx6tJs9J5g']) at 0x7f8a0fcd5490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530c96407340435c982fd99367689007', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:31.758133 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb74bc-a24c-464a-982b-41370663c851 service placement] REQUEST_METHOD: `GET` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:31.758421 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb74bc-a24c-464a-982b-41370663c851 service placement] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:31.758704 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb74bc-a24c-464a-982b-41370663c851 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:31.760999 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-44cb74bc-a24c-464a-982b-41370663c851 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:31.771961 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb74bc-a24c-464a-982b-41370663c851 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:31.773539 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb74bc-a24c-464a-982b-41370663c851 service placement] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:31.783981 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 625/1253] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 23:08:31 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:08:39.912977 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:41.779731 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=40 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:55.701560 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2041cb-eff5-4dc0-b7d1-099fc171485a admin admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:08:55.703055 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-9d2041cb-eff5-4dc0-b7d1-099fc171485a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:55.759586 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2041cb-eff5-4dc0-b7d1-099fc171485a admin admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:08:55.763100 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934b838-a47a-4f27-98b7-5d6dc0d2f469 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=cN26uLfbTCyEEePfC_7Tsw, audit_chain_id=['cN26uLfbTCyEEePfC_7Tsw']) at 0x7f8a0fbafb20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77ef50984084af9bcd220fc68deacf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d1b44363d694c60867ec29af4f9d01e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:08:55.763721 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934b838-a47a-4f27-98b7-5d6dc0d2f469 service neutron] REQUEST_METHOD: `GET` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:08:55.764005 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934b838-a47a-4f27-98b7-5d6dc0d2f469 service neutron] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:08:55.764282 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934b838-a47a-4f27-98b7-5d6dc0d2f469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:08:55.766157 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-e934b838-a47a-4f27-98b7-5d6dc0d2f469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:08:55.828856 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934b838-a47a-4f27-98b7-5d6dc0d2f469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:08:55.830259 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934b838-a47a-4f27-98b7-5d6dc0d2f469 service neutron] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:08:55.839507 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 629/1254] 10.222.0.47 () {60 vars in 1365 bytes} [Mon Jul 25 23:08:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:09:02.186424 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb74bc-a24c-464a-982b-41370663c851 service placement] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:02.188737 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-44cb74bc-a24c-464a-982b-41370663c851 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:02.201966 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb74bc-a24c-464a-982b-41370663c851 service placement] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:02.206560 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7a1b8-2b16-497e-a796-cbdaef179127 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=62cJw11fR7u8apeQrM0CVg, audit_chain_id=['62cJw11fR7u8apeQrM0CVg']) at 0x7f8a0f9748b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:02.207205 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7a1b8-2b16-497e-a796-cbdaef179127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:02.207494 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7a1b8-2b16-497e-a796-cbdaef179127 admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:02.207776 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7a1b8-2b16-497e-a796-cbdaef179127 admin admin] PATH_INFO: `/v3/users/51baecd04d6d4edd803afa43e8f7f1ba` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:02.208937 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7a1b8-2b16-497e-a796-cbdaef179127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51baecd04d6d4edd803afa43e8f7f1ba)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:02.210898 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7a1b8-2b16-497e-a796-cbdaef179127 admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:02.260776 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-43d7a1b8-2b16-497e-a796-cbdaef179127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51baecd04d6d4edd803afa43e8f7f1ba'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:02.267863 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-43d7a1b8-2b16-497e-a796-cbdaef179127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51baecd04d6d4edd803afa43e8f7f1ba'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:02.268526 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-43d7a1b8-2b16-497e-a796-cbdaef179127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51baecd04d6d4edd803afa43e8f7f1ba'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:02.269135 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-43d7a1b8-2b16-497e-a796-cbdaef179127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51baecd04d6d4edd803afa43e8f7f1ba'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:02.280893 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-43d7a1b8-2b16-497e-a796-cbdaef179127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51baecd04d6d4edd803afa43e8f7f1ba'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:02.294011 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 626/1255] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Jul 25 23:09:02 2022] DELETE /identity/v3/users/51baecd04d6d4edd803afa43e8f7f1ba => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:09:02.478793 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934b838-a47a-4f27-98b7-5d6dc0d2f469 service neutron] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:02.490848 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934b838-a47a-4f27-98b7-5d6dc0d2f469 service neutron] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:02.548046 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e96ea4-3070-4c6c-b747-bfecb53a2a3b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=62cJw11fR7u8apeQrM0CVg, audit_chain_id=['62cJw11fR7u8apeQrM0CVg']) at 0x7f8a0fc18430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:02.548600 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e96ea4-3070-4c6c-b747-bfecb53a2a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:02.548886 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e96ea4-3070-4c6c-b747-bfecb53a2a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:02.549241 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e96ea4-3070-4c6c-b747-bfecb53a2a3b admin admin] PATH_INFO: `/v3/projects/530a3ef643e644139ab444eca394b407` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:02.550431 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e96ea4-3070-4c6c-b747-bfecb53a2a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=530a3ef643e644139ab444eca394b407)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:02.552327 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e96ea4-3070-4c6c-b747-bfecb53a2a3b admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:02.597308 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-91e96ea4-3070-4c6c-b747-bfecb53a2a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '530a3ef643e644139ab444eca394b407', 'request_id': 'req-91e96ea4-3070-4c6c-b747-bfecb53a2a3b'} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:02.599760 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:02.605354 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-91e96ea4-3070-4c6c-b747-bfecb53a2a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '530a3ef643e644139ab444eca394b407', 'request_id': 'req-91e96ea4-3070-4c6c-b747-bfecb53a2a3b'} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:02.612207 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-91e96ea4-3070-4c6c-b747-bfecb53a2a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '530a3ef643e644139ab444eca394b407', 'request_id': 'req-91e96ea4-3070-4c6c-b747-bfecb53a2a3b'} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:02.622748 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-91e96ea4-3070-4c6c-b747-bfecb53a2a3b admin admin] The token cache is being invalidate because project 530a3ef643e644139ab444eca394b407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:09:02.623038 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-91e96ea4-3070-4c6c-b747-bfecb53a2a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:02.623672 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-91e96ea4-3070-4c6c-b747-bfecb53a2a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:02.625162 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 630/1256] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Jul 25 23:09:02 2022] DELETE /identity/v3/projects/530a3ef643e644139ab444eca394b407 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:09:02.629183 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7a1b8-2b16-497e-a796-cbdaef179127 admin admin] Authenticating user token {{(pid=93655) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:02.630655 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.fernet_utils [None req-43d7a1b8-2b16-497e-a796-cbdaef179127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93655) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:02.643908 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7a1b8-2b16-497e-a796-cbdaef179127 admin admin] Validating token access rules against request {{(pid=93655) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:02.700815 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896a372-3e21-4555-aa4e-64fc79fdbdd8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=62cJw11fR7u8apeQrM0CVg, audit_chain_id=['62cJw11fR7u8apeQrM0CVg']) at 0x7f8a0fa058e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93655) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:02.701455 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896a372-3e21-4555-aa4e-64fc79fdbdd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:02.701876 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896a372-3e21-4555-aa4e-64fc79fdbdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:02.702157 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896a372-3e21-4555-aa4e-64fc79fdbdd8 admin admin] PATH_INFO: `/v3/users/a2bbe8186fa849fdb221ca4a15b95503` {{(pid=93655) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:02.704056 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896a372-3e21-4555-aa4e-64fc79fdbdd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2bbe8186fa849fdb221ca4a15b95503)` {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:02.705995 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896a372-3e21-4555-aa4e-64fc79fdbdd8 admin admin] RBAC: Authorization granted {{(pid=93655) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:02.752260 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-3896a372-3e21-4555-aa4e-64fc79fdbdd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2bbe8186fa849fdb221ca4a15b95503'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:02.759037 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-3896a372-3e21-4555-aa4e-64fc79fdbdd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2bbe8186fa849fdb221ca4a15b95503'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:02.759696 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-3896a372-3e21-4555-aa4e-64fc79fdbdd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2bbe8186fa849fdb221ca4a15b95503'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:02.760298 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-3896a372-3e21-4555-aa4e-64fc79fdbdd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2bbe8186fa849fdb221ca4a15b95503'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:02.772835 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG keystone.notifications [None req-3896a372-3e21-4555-aa4e-64fc79fdbdd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2bbe8186fa849fdb221ca4a15b95503'} {{(pid=93655) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:02.774500 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:02.787480 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: [pid: 93655|app: 0|req: 627/1257] 10.222.0.47 () {58 vars in 1224 bytes} [Mon Jul 25 23:09:02 2022] DELETE /identity/v3/users/a2bbe8186fa849fdb221ca4a15b95503 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 23:09:02.960631 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e96ea4-3070-4c6c-b747-bfecb53a2a3b admin admin] Authenticating user token {{(pid=93656) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:09:02.962110 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.fernet_utils [None req-91e96ea4-3070-4c6c-b747-bfecb53a2a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93656) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:09:02.979108 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e96ea4-3070-4c6c-b747-bfecb53a2a3b admin admin] Validating token access rules against request {{(pid=93656) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:09:03.036427 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e81e3f-719b-4387-9461-a261c35f2dfa admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=62cJw11fR7u8apeQrM0CVg, audit_chain_id=['62cJw11fR7u8apeQrM0CVg']) at 0x7f8a140cc880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21915d6d53c54080a8c4d15c72508181', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbcbafb1154a42cbb08b02e29c87618d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93656) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:09:03.037065 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e81e3f-719b-4387-9461-a261c35f2dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:09:03.037344 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e81e3f-719b-4387-9461-a261c35f2dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:09:03.037643 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e81e3f-719b-4387-9461-a261c35f2dfa admin admin] PATH_INFO: `/v3/projects/1c1e535cd5814d1693f189b064d1656b` {{(pid=93656) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:09:03.038779 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e81e3f-719b-4387-9461-a261c35f2dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1e535cd5814d1693f189b064d1656b)` {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:09:03.040694 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e81e3f-719b-4387-9461-a261c35f2dfa admin admin] RBAC: Authorization granted {{(pid=93656) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:09:03.086582 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-30e81e3f-719b-4387-9461-a261c35f2dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1e535cd5814d1693f189b064d1656b', 'request_id': 'req-30e81e3f-719b-4387-9461-a261c35f2dfa'} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:03.094045 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-30e81e3f-719b-4387-9461-a261c35f2dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1e535cd5814d1693f189b064d1656b', 'request_id': 'req-30e81e3f-719b-4387-9461-a261c35f2dfa'} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:03.099751 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-30e81e3f-719b-4387-9461-a261c35f2dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1e535cd5814d1693f189b064d1656b', 'request_id': 'req-30e81e3f-719b-4387-9461-a261c35f2dfa'} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:03.110489 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-30e81e3f-719b-4387-9461-a261c35f2dfa admin admin] The token cache is being invalidate because project 1c1e535cd5814d1693f189b064d1656b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93656) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:09:03.110776 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-30e81e3f-719b-4387-9461-a261c35f2dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:03.111407 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG keystone.notifications [None req-30e81e3f-719b-4387-9461-a261c35f2dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93656) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:09:03.112932 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: [pid: 93656|app: 0|req: 631/1258] 10.222.0.47 () {58 vars in 1233 bytes} [Mon Jul 25 23:09:02 2022] DELETE /identity/v3/projects/1c1e535cd5814d1693f189b064d1656b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:09:12.786703 dv-osbrick-849020-3-ceph devstack@keystone.service[93655]: DEBUG dbcounter [-] [93655] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=93655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:13.107531 dv-osbrick-849020-3-ceph devstack@keystone.service[93656]: DEBUG dbcounter [-] [93656] Writing DB stats keystone:DELETE=10,keystone:SELECT=57,keystone:INSERT=1 {{(pid=93656) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}